-- Logs begin at Mon 2022-02-21 03:34:21 UTC, end at Mon 2022-02-21 04:42:21 UTC. -- Feb 21 04:05:31.615621 dv-cinder-773985-36-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 21 04:05:31.623098 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 04:05:31 2022] *** Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: nodename: dv-cinder-773985-36-iscsi Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: machine: x86_64 Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: clock source: unix Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: pcre jit disabled Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: detected number of CPU cores: 4 Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: current working directory: / Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: detected binary path: /usr/bin/uwsgi-core Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: your processes number limit is 47680 Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: your memory page size is 4096 bytes Feb 21 04:05:31.625652 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: detected max file descriptor number: 2048 Feb 21 04:05:31.626463 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: lock engine: pthread robust mutexes Feb 21 04:05:31.626463 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: thunder lock: enabled Feb 21 04:05:31.626463 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 21 04:05:31.626463 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 04:05:31.670954 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: Python main interpreter initialized at 0x556fd07ef9c0 Feb 21 04:05:31.670954 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: python threads support enabled Feb 21 04:05:31.670954 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: your server socket listen backlog is limited to 100 connections Feb 21 04:05:31.670954 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: your mercy for graceful operations on workers is 90 seconds Feb 21 04:05:31.671279 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 04:05:31.671367 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: *** Operational MODE: preforking *** Feb 21 04:05:31.671612 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: *** uWSGI is running in multiple interpreter mode *** Feb 21 04:05:31.671612 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: spawned uWSGI master process (pid: 102158) Feb 21 04:05:31.671798 dv-cinder-773985-36-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 21 04:05:31.672527 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: spawned uWSGI worker 1 (pid: 102159, cores: 1) Feb 21 04:05:31.672681 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: spawned uWSGI worker 2 (pid: 102160, cores: 1) Feb 21 04:05:31.672829 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 04:05:33.536604 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 04:05:33.536604 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: from cryptography.utils import int_from_bytes Feb 21 04:05:33.537296 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 04:05:33.537296 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: from cryptography.utils import int_from_bytes Feb 21 04:05:33.567170 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 04:05:33.567170 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: from cryptography.utils import int_from_bytes Feb 21 04:05:33.567170 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 04:05:33.567170 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: from cryptography.utils import int_from_bytes Feb 21 04:05:36.120029 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 04:05:36.120544 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 04:05:36.120936 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 04:05:36.121046 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 04:05:36.121141 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 04:05:36.121224 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 04:05:36.121304 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 04:05:36.121384 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 04:05:36.121464 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 04:05:36.121550 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 04:05:36.121737 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.121883 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.122069 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.122210 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.122398 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.122535 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.122724 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.122861 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.123058 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.123195 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.123377 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.123508 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.124285 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.124412 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.124614 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.124749 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.124973 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.125062 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.125238 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.125332 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.125560 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.125647 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.125891 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773985-36-iscsi {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.125979 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773985-36-iscsi {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.126219 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.126313 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.126532 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.126627 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.126842 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.126933 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.127162 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.127255 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.127467 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.127563 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.127793 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.127877 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.128103 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.128197 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.128604 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.128739 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.129055 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.129186 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.129362 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.129462 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.129675 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.129768 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.130013 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.130111 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.130328 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.130413 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.130643 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.130736 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.130962 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.131047 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.131271 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.131434 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.131599 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.131685 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.131911 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.131994 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.132305 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773985-36-iscsi {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.132401 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773985-36-iscsi {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.132652 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.132764 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.132965 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.133051 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.133281 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.133391 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.133699 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.133810 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.134008 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.134106 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.134319 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.134416 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.134643 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.134735 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.134968 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.135058 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.135281 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.135373 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.135609 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.135700 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.135933 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.136016 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.136254 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.136340 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.136577 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.136692 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.136910 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.137079 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.137241 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.137382 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.137553 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.137699 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.137843 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.137992 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.138143 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.138281 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.138419 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.138562 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.138710 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.138856 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.138994 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.139136 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.139293 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.139430 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.139599 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.139752 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.139924 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.140073 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.140272 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.140430 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.140430 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.140743 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.140883 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.141029 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.141196 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.141390 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.141542 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.141681 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.141816 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.141951 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.142104 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.142250 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.142387 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.142529 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.142675 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.142812 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.142947 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.143090 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.143227 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.143368 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.143516 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.143661 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.143807 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.143970 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.144115 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.144252 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.144398 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.144534 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.144698 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.144853 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.144997 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.145135 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.145355 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.145498 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.145647 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.145799 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.145961 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.146099 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.146234 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.146377 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.146527 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.146671 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.146834 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.146976 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.147157 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.147306 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.147479 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.147633 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.147771 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.147919 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.148084 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.148227 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.148393 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.148545 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.148739 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.148896 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.149074 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.149215 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.149385 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.149526 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.149663 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.149814 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.149953 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.150095 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.150232 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.150368 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.150512 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.150649 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.150817 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.150967 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.151111 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.151249 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.151421 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.151570 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.151718 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.151862 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.152023 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.152415 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.152589 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.152766 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.152905 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.153050 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.153215 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.153358 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.153527 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.153670 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.153819 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.153969 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.154131 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.154281 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.154417 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.154551 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.154727 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.154890 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.155073 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.155217 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.155393 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.155540 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.155688 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.155831 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.156000 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.156144 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.156304 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.156445 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.156612 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.156891 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.157111 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.157258 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.157258 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.157519 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.157662 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.157807 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.157944 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.158100 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.158238 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.158381 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.158532 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.158670 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.158814 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.158951 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.159094 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.159230 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.159379 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.159516 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.159651 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.159786 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.159932 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.160068 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.160212 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.160355 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.160522 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.160688 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.160853 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.161011 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.161149 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.161284 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.161454 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.161597 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.161767 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.161918 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.162056 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.162201 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.162369 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.162521 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.162658 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.162801 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.162945 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.163082 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.163247 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.163397 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.163567 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.163729 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.163891 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.164032 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.164197 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.164345 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.164490 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.164680 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.164826 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.164961 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.165134 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.165289 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:05:36.165469 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.165623 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.165799 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.165947 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.166142 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.166283 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.166455 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.166596 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.166789 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.166933 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.167119 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.167269 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.167438 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.167580 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.167749 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.167897 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.168065 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.168221 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.168393 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.168542 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.168715 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.168865 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.169032 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.169185 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.169345 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.169486 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.169661 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.169812 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.169981 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.170131 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.170309 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.170993 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.171148 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.171285 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.171467 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.171620 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.171788 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.171939 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.172105 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.172266 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.172427 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.172580 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.172784 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.172929 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.173111 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.173256 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.173428 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.173585 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.173775 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.173919 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.174122 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.174265 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.174425 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.174561 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.174755 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.174897 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.175078 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.175228 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.175378 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.175515 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.175690 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.175834 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.176002 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.176152 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.176324 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.176477 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.176672 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.176823 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.176992 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.177145 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.177296 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.177434 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.177614 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.177758 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.177930 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.178080 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.178225 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.178362 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.178542 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.178686 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.178857 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.179073 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.179220 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.179357 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.179494 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.179630 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.179798 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.179951 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.180113 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.180258 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.180433 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.180583 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.180770 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.180925 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.181063 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.181199 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.181376 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.181520 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.181682 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.181839 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.181978 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.182114 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.182284 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.182438 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.182585 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.182727 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.182890 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.183034 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.183210 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.183352 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.183540 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.183692 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.183852 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.183994 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.184185 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.184327 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.184482 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.184619 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.184821 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.184965 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.185132 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.185285 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.185430 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.185566 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.185741 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.185884 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.186055 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.186786 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.186946 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.187108 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.187254 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.187397 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.187541 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.187698 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.187844 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.187987 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.188138 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.188282 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.188452 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.188607 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.188815 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.188970 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.189126 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.189277 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.189430 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.189575 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.189718 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.189862 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.190005 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.190149 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.190304 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.190448 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.190591 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.190740 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.190903 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.191048 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.191200 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.191354 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.191499 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.191643 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.191833 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.191992 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.192170 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.192322 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.192473 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.192624 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.192810 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.192976 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.193121 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.193264 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.193441 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.193592 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.193736 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.193891 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.194044 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.194188 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.194331 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.194474 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.194616 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.194768 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.194923 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.195067 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.195211 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.195353 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.195496 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.195648 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.195799 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.195943 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.196093 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.196238 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.196389 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.196533 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.196723 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.196893 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.197042 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.197194 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.197347 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.197490 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.197633 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.197776 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.197918 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.198060 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.198269 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.198419 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.198562 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.198719 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.198862 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.199004 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.199155 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.199300 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.199442 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.199584 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.199757 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.199917 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.200069 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.200212 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.200386 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.200538 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.200728 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.200889 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.201035 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.201177 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.201320 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.201462 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.201637 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.201857 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.202011 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.202155 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.202298 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.202441 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.202584 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.202745 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.202890 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.203040 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.203184 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.203328 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.203479 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.203631 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.203776 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.203919 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.204098 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.204249 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.204400 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.204554 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.204754 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.204901 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.205044 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.205186 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.205378 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.205532 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.205698 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.205846 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.206018 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.206167 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.206319 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.206469 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.206621 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.206782 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.206939 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.207086 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.207243 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.207395 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.207538 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.207682 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.207825 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.208044 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.208191 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.208341 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.208485 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.208674 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.208827 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.208982 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.209134 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.209279 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.209421 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.209563 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.209713 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.209865 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.210016 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.210165 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.210308 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.210457 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.210611 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.210764 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.210916 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.211059 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.211232 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.211383 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.211554 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.211714 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.211860 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.212003 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.212181 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.212330 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.212486 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.212696 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.212850 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.212993 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.213145 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.213297 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.213450 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.213594 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.213737 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.213879 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.214029 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.214180 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.214333 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.214478 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.214637 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.214782 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.214925 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.215075 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.215228 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.215372 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.215550 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.215694 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.215837 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.215988 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.216134 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.216277 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.216466 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.216623 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.216796 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.216961 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.217114 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.217257 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.217909 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.218054 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.218197 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.218349 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.218493 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.218636 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.218778 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.218932 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.219083 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.219242 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.219387 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.219536 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.219679 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.219822 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.219973 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.220117 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.220260 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.220409 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.220553 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.220733 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.220920 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.221090 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.221240 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.221384 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.221527 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.221669 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.221822 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.221966 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.222118 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.222270 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.222415 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.222558 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.222711 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.222875 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.223020 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.223162 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.223306 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.223461 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.223606 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.223749 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.223891 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.224032 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.224175 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.224327 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.224480 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.224624 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.224847 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.224993 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.225144 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.225300 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.225446 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.225589 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.225738 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.225890 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.226034 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.226185 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.226330 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.226481 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.226637 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.226798 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.226957 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.227102 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.227246 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.227396 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.227568 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.227714 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.227988 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.228179 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.228330 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.228517 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.228704 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.228865 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.229025 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.229170 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.229312 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.229485 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.229637 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.229807 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.229962 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.230130 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.230301 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.230477 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.230630 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.230789 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.230944 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.231097 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.231255 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.231408 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.231553 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.231695 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.231865 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.232011 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.232224 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.232370 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.232513 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.232691 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.232857 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.233548 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.233714 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.233861 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.234013 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.234158 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.234301 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.234472 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.234625 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.234769 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.234943 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.235088 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.235233 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.235396 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.235541 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.235684 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.235827 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.235994 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.236151 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.236305 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.236476 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.236649 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.236812 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.236965 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.237113 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.237265 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.237420 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.237564 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.237708 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.237851 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.237993 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.238147 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.238299 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.238469 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.238614 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.238758 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.238914 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.239061 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.239204 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.239358 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.239501 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.239644 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.239800 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.239945 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.240095 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.240240 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.240392 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.240538 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.240744 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.240895 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.241039 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.241193 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.241345 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.241499 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.241651 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.241795 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.241940 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.242083 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.242226 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.242382 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.242528 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.242670 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.242821 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.242966 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.243127 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.243285 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.243431 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.243574 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.243717 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.243867 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.244011 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.244162 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.244307 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.244457 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.244601 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.244767 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.244923 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.245078 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.245229 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.245375 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.245517 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.245661 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.245813 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.245958 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.246100 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.246243 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.246385 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.246529 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.246680 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.246825 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.246987 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.247138 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.247282 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.247433 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.247591 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.247743 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.247887 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.248030 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.248172 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.248324 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.248468 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.248646 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.248812 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.248956 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.249099 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.249253 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.249404 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.249551 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.249701 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.249846 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.249989 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.250140 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.250285 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.250428 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.250571 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.250725 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.250869 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.251021 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.251165 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.251308 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.251451 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.251600 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.251755 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.251899 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.252049 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.252193 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.252343 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.252487 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.252682 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.252834 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.252988 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.253132 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.253275 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.253418 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.253574 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.253726 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.253871 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.254014 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.254156 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.254299 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.254451 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.254606 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.254750 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.254894 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.255037 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.255188 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.255340 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.255484 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.255627 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.255770 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.255914 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.256065 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.256210 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.256352 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.256505 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.256667 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.256817 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.256984 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.257130 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.257273 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.257416 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.257589 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.257747 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.257904 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.258050 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.258194 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.258353 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.258499 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.258651 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.258796 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.258965 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.259116 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.259287 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.259437 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.259610 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.259761 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.259932 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.260083 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.260246 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.260406 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.260622 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.260817 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.260961 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.261106 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.261249 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.261392 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.261547 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.261692 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.261835 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.261977 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.262127 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.262271 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.262434 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.262577 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.262720 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.262863 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.263041 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.263206 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.263358 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.263501 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.263652 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.263797 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.263940 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.264091 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.264268 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.264425 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.264577 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.264755 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.264899 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.265055 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.265205 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.265351 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.265494 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.265643 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.265787 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.265938 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.266082 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.266225 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.266379 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.266522 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.266673 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.266817 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.266970 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.267114 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.267256 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.267406 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.267558 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.267702 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.267854 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.267998 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.268151 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.268294 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.268447 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.268591 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.268798 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.268941 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.269081 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.269208 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.269352 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.269526 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.269660 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.269839 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.270087 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.270185 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.270408 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.270495 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.270724 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.270907 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.271034 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.271232 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.271349 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.271554 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.271649 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.271868 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.271954 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.272190 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.272277 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.272510 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.272596 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.272860 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.272989 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.273183 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.273304 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.273496 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.273617 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.273923 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.274037 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.274229 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.274332 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.274534 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.274622 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.274846 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.274955 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.275158 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.275255 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.275463 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.275549 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.275772 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.275867 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.276078 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.276164 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.276396 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.276480 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.276722 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.276825 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.277038 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.277129 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.277646 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.277733 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.277956 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.278050 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.278284 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.278395 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.278708 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.278798 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.279024 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.279161 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.279334 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.279426 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.279655 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.279741 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.280497 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.280589 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.280854 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.280942 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.281166 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.281252 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.281483 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.281572 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.281796 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.281889 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.282122 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.282224 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.282448 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.282535 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.282765 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.282853 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.283085 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.283174 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.283394 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.283495 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.283720 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.283813 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.284044 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.284174 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.284356 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.284451 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.284698 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.284788 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.285034 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.285119 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.285360 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.285467 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.285691 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.285779 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.286040 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.286125 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.286369 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.286464 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.286679 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.286769 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.286990 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.287077 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.287305 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.287393 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.287613 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.287699 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.287920 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.288006 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.288246 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.288335 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.288555 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.288678 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.288892 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.288977 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.289204 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.289291 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.289517 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.289604 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.289825 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.289911 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.290132 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.290219 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.290446 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.290532 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.290755 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.290848 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.291063 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.291147 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.291385 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.291476 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.291693 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.291787 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.292022 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.292108 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.292330 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.292416 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.292680 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.292789 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.292997 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.293082 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.293304 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.293390 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.293614 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.293713 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.293922 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.294009 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.294232 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.294316 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.294544 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.294631 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.294853 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.294947 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.295193 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.295277 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.296984 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.297090 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.297186 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.297276 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.297357 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.297444 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.297534 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.297615 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.297694 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.297780 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.297860 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.297947 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.298028 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.298114 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.298298 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.298386 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.298605 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.298750 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.298920 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.299007 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.299228 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.299351 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.299535 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.299633 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.299839 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.299926 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.300147 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.300240 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.300451 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.300545 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.300782 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.300869 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.301094 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.301180 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.301401 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.301533 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.301711 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.301798 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.302022 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.302117 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.302334 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.302420 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.302643 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.302730 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.302954 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.303042 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.303259 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.303356 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.303565 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.303662 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.303877 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.303970 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.304184 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.304272 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.304522 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.304607 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.304862 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.304958 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.305191 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.305285 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.305504 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.305603 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.305830 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.305924 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.306150 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.306236 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.306465 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.306575 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.306780 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.306873 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.307098 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.307184 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.307416 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.307502 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.307735 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.307829 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.308051 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.308136 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.308363 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.308447 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.308702 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.308885 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.309018 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.309103 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.309330 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.309459 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.309652 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.309851 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.309972 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.310180 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.310295 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.310499 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.310818 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.310906 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.311178 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.311268 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.311498 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.311593 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.311818 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.311906 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.312137 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.312222 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.312451 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.312547 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.312791 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.312880 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.313108 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.313194 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.313423 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.313520 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.313741 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.313841 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.314061 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.314147 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.314395 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.314491 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.314714 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.314799 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.315032 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.315124 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.315349 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.315437 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.315665 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.315755 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.315984 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.316070 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.316306 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.316396 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.316663 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.316763 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.316965 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.317061 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.317285 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.317372 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.317605 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.317691 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.317921 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.318022 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.318237 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.318324 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.318556 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.318642 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.318871 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.318964 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.319185 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.319270 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.319499 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.319585 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.319816 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.319903 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.320129 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.320217 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.320442 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.320526 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.320792 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.320949 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.321116 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.321205 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.321439 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.321523 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.321758 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.321846 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.322078 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.322174 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.322401 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.322606 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.322722 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.322929 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.323045 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.323268 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.323569 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.323668 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.323890 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.323976 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.324222 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.324306 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.324542 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.324655 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.324899 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.324986 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.325214 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.325300 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.325526 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.325625 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.325844 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.325931 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.326157 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.326249 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.326464 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.326550 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.326802 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.326898 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.327119 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.327210 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.327428 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.327513 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.327753 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.327846 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.328066 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.328150 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.328375 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.328606 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.328747 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.328976 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.329063 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.329298 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.329554 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.329687 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.329905 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.329992 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.330230 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.330329 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.330554 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.330646 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.330884 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.330968 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.331192 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.331453 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.331562 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.331645 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.331810 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.331898 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.332124 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.332218 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.332435 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.332520 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.332773 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.332877 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.333093 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.333181 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.333405 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.333495 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.333712 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.333798 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.334027 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.334113 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.334336 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.334429 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.334643 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.334728 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.334959 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.335048 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.335267 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.335352 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.335577 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.335672 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.335890 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.335979 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.336198 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.336295 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.336506 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.336605 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.336835 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.336936 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.337145 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.337231 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.337457 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.337554 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.337764 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.337850 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.338070 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.338155 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.338377 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.338537 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.338684 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.338771 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.338991 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.339129 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.339298 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.339393 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.339615 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.339703 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.339925 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.340011 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.340237 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.340333 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.340551 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.340655 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.340932 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.341019 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.341243 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.341339 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.341564 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.341659 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.341873 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.341960 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.342188 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.342274 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.343028 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.343116 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.343347 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.343439 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.343663 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.343885 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.344014 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.344226 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.344338 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.344551 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.344902 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.344993 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.345242 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.345327 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.345555 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.345654 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.345866 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.345956 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.346176 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.346268 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.346502 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.346661 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.346811 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.346903 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.347122 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.347210 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.347436 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.347530 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.347752 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.347852 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.348065 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.348160 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.348378 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.348465 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.348712 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.348804 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.349030 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.349133 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.349344 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.349438 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.349655 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.349740 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.349973 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.350105 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.350284 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.350396 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.350599 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.350712 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.350916 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.351025 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.351236 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.351343 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.351554 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.351651 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.351874 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.351982 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.352188 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.352299 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.352503 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.352601 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.352842 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.352952 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.353157 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.353261 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.353472 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.353570 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.353786 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.353894 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.354099 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.354196 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.354405 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.354502 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.354756 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.354856 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.355059 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.355161 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.355367 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.355460 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.355740 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.355833 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.356055 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.356148 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.356380 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.356473 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.356728 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.356839 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.357045 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.357148 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.357367 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.357467 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.357682 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.357775 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.358040 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.358626 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.358855 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.358952 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.359174 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.359324 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.359510 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.359608 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.359854 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.359985 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.360166 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.360251 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.360477 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.360564 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.360819 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.360911 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.361130 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.361215 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.361441 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.361529 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.361756 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.361845 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.362092 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.362180 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.362403 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.362488 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.362729 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.362817 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.363045 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.363132 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.363362 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.363455 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.363684 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.363769 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.363996 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.364080 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.364307 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.364400 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.364657 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.364745 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.364972 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.365069 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.365282 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.365381 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.365594 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.365679 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.365908 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.365995 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.366222 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.366321 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.366535 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.366620 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.366851 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.366937 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.367165 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.367253 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.367472 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.367557 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.367800 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.367885 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.368117 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.368204 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.368427 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.368512 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.368765 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.368854 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.369082 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.369171 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.369416 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.369520 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.369729 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.369839 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.370083 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.370183 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.370356 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.370452 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.370668 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.370775 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.370980 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.371076 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.371299 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.371397 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.371614 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.371730 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.371929 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.372027 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.372250 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.372347 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.372569 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.372700 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.372922 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.373018 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.373252 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.373348 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.373611 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.373716 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.373925 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.374017 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.374264 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.374365 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.374584 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.374678 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.374901 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.375002 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.375211 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.375304 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.375496 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 04:05:36.375587 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.375858 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.376170 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:05:36.376421 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 04:05:36.398315 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_db.sqlalchemy.engines [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:05:36.399448 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG oslo_db.sqlalchemy.engines [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:05:36.460989 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.context [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5698d2f8-fc88-4d55-adc3-7e1555697e28(cell1) {{(pid=102160) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 04:05:36.461177 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.context [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5698d2f8-fc88-4d55-adc3-7e1555697e28(cell1) {{(pid=102159) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 04:05:36.465174 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG oslo_concurrency.lockutils [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:05:36.465291 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:05:36.466731 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG oslo_concurrency.lockutils [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:05:36.466841 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:05:36.468019 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG oslo_concurrency.lockutils [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:05:36.468127 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:05:36.469961 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG oslo_concurrency.lockutils [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:05:36.470058 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:05:36.479892 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG oslo_db.sqlalchemy.engines [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:05:36.482758 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_db.sqlalchemy.engines [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:05:36.492794 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG oslo_db.sqlalchemy.engines [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:05:36.648404 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG oslo_db.sqlalchemy.engines [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:05:36.657143 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_db.sqlalchemy.engines [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:05:36.678631 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_db.sqlalchemy.engines [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:05:37.001072 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: WARNING keystonemiddleware.auth_token [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 04:05:37.001928 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: WARNING keystonemiddleware.auth_token [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 04:05:37.007588 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: WARNING keystonemiddleware.auth_token [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 04:05:37.008522 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: WARNING keystonemiddleware.auth_token [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 04:05:37.349750 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: WARNING keystonemiddleware.auth_token [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 04:05:37.350677 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: WARNING keystonemiddleware.auth_token [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 04:05:37.354897 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: WARNING keystonemiddleware.auth_token [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 04:05:37.355807 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: WARNING keystonemiddleware.auth_token [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 04:05:37.360321 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556fd07ef9c0 pid: 102160 (default app) Feb 21 04:05:37.361192 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556fd07ef9c0 pid: 102159 (default app) Feb 21 04:05:37.362407 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:05:37.363570 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-dc820554-02ae-4162-8fa5-da12520f26f4 None None] 10.222.0.10 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001720 Feb 21 04:05:37.363991 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 1/1] 10.222.0.10 () {50 vars in 788 bytes} [Mon Feb 21 04:05:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:06:58.575407 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:06:58.576750 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002132 Feb 21 04:06:58.577258 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 1/2] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:06:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:06:59.003140 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-3abce8d2-94d2-4e6e-b7ba-8b65ee817f7d admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:06:59.033078 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-3abce8d2-94d2-4e6e-b7ba-8b65ee817f7d admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.449844 Feb 21 04:06:59.033860 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 2/3] 10.222.0.10 () {60 vars in 1291 bytes} [Mon Feb 21 04:06:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:07:01.386113 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:01.387133 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-90bdcd38-c59a-4b6f-89f0-1af72f4eff37 None None] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Feb 21 04:07:01.387547 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 2/4] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:07:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:01.445802 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-ca4f117f-8f2e-4d01-a46f-09162682f356 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256"}} {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:01.464057 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:07:01.464057 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: warnings.warn(msg) Feb 21 04:07:01.492254 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-ca4f117f-8f2e-4d01-a46f-09162682f356 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.098881 Feb 21 04:07:01.500209 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 3/5] 10.222.0.10 () {64 vars in 1282 bytes} [Mon Feb 21 04:07:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:07:01.714524 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-20c1ac14-21c4-43ce-83c3-e8dcf0325bc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:01.717452 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:07:01.717452 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: warnings.warn(msg) Feb 21 04:07:01.766079 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-20c1ac14-21c4-43ce-83c3-e8dcf0325bc7 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.264440 Feb 21 04:07:01.766680 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 3/6] 10.222.0.10 () {64 vars in 1335 bytes} [Mon Feb 21 04:07:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:07:04.144859 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-ca4f117f-8f2e-4d01-a46f-09162682f356 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:04.146445 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-ca4f117f-8f2e-4d01-a46f-09162682f356 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002080 Feb 21 04:07:04.146865 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 4/7] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:07:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:04.266584 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-0ad21aee-571c-4068-a06c-137a46febd4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "swap": 0}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:04.286619 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:07:04.286619 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: warnings.warn(msg) Feb 21 04:07:04.309375 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-0ad21aee-571c-4068-a06c-137a46febd4b admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155092 Feb 21 04:07:04.311093 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 4/8] 10.222.0.10 () {64 vars in 1282 bytes} [Mon Feb 21 04:07:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 04:07:04.323164 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-8ad28be8-ad1b-4f2b-9dc9-55c2eaf14962 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:04.324595 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:07:04.324595 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: warnings.warn(msg) Feb 21 04:07:04.359358 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-8ad28be8-ad1b-4f2b-9dc9-55c2eaf14962 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039991 Feb 21 04:07:04.359940 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 5/9] 10.222.0.10 () {64 vars in 1335 bytes} [Mon Feb 21 04:07:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:07:06.708234 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-0ad21aee-571c-4068-a06c-137a46febd4b admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:06.709476 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-0ad21aee-571c-4068-a06c-137a46febd4b admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Feb 21 04:07:06.710017 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 5/10] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:07:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:06.773145 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-83087668-a2a0-4a69-8d2c-7974f9aa6526 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:06.794792 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-83087668-a2a0-4a69-8d2c-7974f9aa6526 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079004 Feb 21 04:07:06.795875 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 6/11] 10.222.0.10 () {64 vars in 1282 bytes} [Mon Feb 21 04:07:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 04:07:06.807906 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-22fc05f9-fe4a-4bc5-b922-d84fbb8b62c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:06.832515 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-22fc05f9-fe4a-4bc5-b922-d84fbb8b62c3 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028813 Feb 21 04:07:06.833812 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 6/12] 10.222.0.10 () {64 vars in 1335 bytes} [Mon Feb 21 04:07:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:07:09.173107 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-83087668-a2a0-4a69-8d2c-7974f9aa6526 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:09.174109 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-83087668-a2a0-4a69-8d2c-7974f9aa6526 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Feb 21 04:07:09.174515 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 7/13] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:09.239406 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-84b7b5dd-97e1-4526-8796-4161d0935c45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:09.256975 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-84b7b5dd-97e1-4526-8796-4161d0935c45 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076653 Feb 21 04:07:09.257634 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 7/14] 10.222.0.10 () {64 vars in 1282 bytes} [Mon Feb 21 04:07:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 04:07:09.278340 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-0e50dcc4-26f3-4c4c-a9c7-55eb534a5d45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:09.304909 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-0e50dcc4-26f3-4c4c-a9c7-55eb534a5d45 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033706 Feb 21 04:07:09.305804 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 8/15] 10.222.0.10 () {64 vars in 1335 bytes} [Mon Feb 21 04:07:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:07:11.721640 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-84b7b5dd-97e1-4526-8796-4161d0935c45 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:11.722711 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-84b7b5dd-97e1-4526-8796-4161d0935c45 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Feb 21 04:07:11.723128 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 8/16] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:11.782937 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-f59f761b-4c38-4c97-8cc1-02fe9068fe76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:11.802931 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-f59f761b-4c38-4c97-8cc1-02fe9068fe76 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074046 Feb 21 04:07:11.803483 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 9/17] 10.222.0.10 () {64 vars in 1282 bytes} [Mon Feb 21 04:07:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:07:11.815716 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-53a28ada-691b-4cb9-bcc5-7d798bce07f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:11.839351 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-53a28ada-691b-4cb9-bcc5-7d798bce07f2 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027220 Feb 21 04:07:11.839977 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 9/18] 10.222.0.10 () {64 vars in 1335 bytes} [Mon Feb 21 04:07:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:07:14.181198 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-f59f761b-4c38-4c97-8cc1-02fe9068fe76 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:14.182193 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-f59f761b-4c38-4c97-8cc1-02fe9068fe76 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Feb 21 04:07:14.182591 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 10/19] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:07:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:14.242127 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-676b49d0-d37d-42e4-ae71-aa2240656b30 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:14.265253 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-676b49d0-d37d-42e4-ae71-aa2240656b30 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076050 Feb 21 04:07:14.265959 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 10/20] 10.222.0.10 () {60 vars in 1291 bytes} [Mon Feb 21 04:07:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:07:16.881041 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-f59f761b-4c38-4c97-8cc1-02fe9068fe76 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:16.882038 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-f59f761b-4c38-4c97-8cc1-02fe9068fe76 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Feb 21 04:07:16.882437 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 11/21] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:07:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:16.945280 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-ace48d3e-fed0-40ce-a947-14c268021aa4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:16.962698 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-ace48d3e-fed0-40ce-a947-14c268021aa4 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074432 Feb 21 04:07:16.963232 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 11/22] 10.222.0.10 () {64 vars in 1282 bytes} [Mon Feb 21 04:07:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:07:16.976123 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-93f26a40-35c4-4408-a672-11bb1b086155 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:17.001499 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-93f26a40-35c4-4408-a672-11bb1b086155 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029763 Feb 21 04:07:17.002071 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 12/23] 10.222.0.10 () {64 vars in 1332 bytes} [Mon Feb 21 04:07:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:07:19.374749 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-ace48d3e-fed0-40ce-a947-14c268021aa4 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:19.375753 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-ace48d3e-fed0-40ce-a947-14c268021aa4 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Feb 21 04:07:19.376144 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 12/24] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:07:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:19.441365 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-4beb5ca7-d8a0-4045-ae8b-bb982738a500 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "id": "2", "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:19.459583 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-4beb5ca7-d8a0-4045-ae8b-bb982738a500 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077551 Feb 21 04:07:19.460093 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 13/25] 10.222.0.10 () {64 vars in 1282 bytes} [Mon Feb 21 04:07:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:07:19.472556 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-20f2422f-1288-4731-bef9-110a6822fc0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:19.498401 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-20f2422f-1288-4731-bef9-110a6822fc0e admin admin] 10.222.0.10 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030126 Feb 21 04:07:19.499125 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 13/26] 10.222.0.10 () {64 vars in 1332 bytes} [Mon Feb 21 04:07:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:07:21.860892 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-4beb5ca7-d8a0-4045-ae8b-bb982738a500 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:21.861891 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-4beb5ca7-d8a0-4045-ae8b-bb982738a500 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Feb 21 04:07:21.862323 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 14/27] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:07:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:21.920302 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-b2504425-e30c-4722-849c-d8f106737a03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:21.937731 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-b2504425-e30c-4722-849c-d8f106737a03 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069486 Feb 21 04:07:21.938295 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 14/28] 10.222.0.10 () {64 vars in 1282 bytes} [Mon Feb 21 04:07:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 04:07:21.949815 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-801e88a5-3e27-44ef-a6d7-ab45ac0e4885 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:21.973427 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-801e88a5-3e27-44ef-a6d7-ab45ac0e4885 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027265 Feb 21 04:07:21.974274 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 15/29] 10.222.0.10 () {64 vars in 1332 bytes} [Mon Feb 21 04:07:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:07:24.562125 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-b2504425-e30c-4722-849c-d8f106737a03 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:24.563123 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-b2504425-e30c-4722-849c-d8f106737a03 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Feb 21 04:07:24.563523 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 15/30] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:07:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:24.620337 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-b2e09a2d-3bcb-43d9-b39f-cec76f2cfa52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "disk": 80}} {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:24.639604 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-b2e09a2d-3bcb-43d9-b39f-cec76f2cfa52 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070330 Feb 21 04:07:24.640153 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 16/31] 10.222.0.10 () {64 vars in 1282 bytes} [Mon Feb 21 04:07:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 04:07:24.651591 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-ec63cfb0-12ee-4af0-a9ff-dde8098911f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:24.674714 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-ec63cfb0-12ee-4af0-a9ff-dde8098911f8 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026766 Feb 21 04:07:24.675598 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 16/32] 10.222.0.10 () {64 vars in 1332 bytes} [Mon Feb 21 04:07:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:07:27.020690 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-b2e09a2d-3bcb-43d9-b39f-cec76f2cfa52 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:27.021699 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-b2e09a2d-3bcb-43d9-b39f-cec76f2cfa52 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Feb 21 04:07:27.022105 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 17/33] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:07:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:27.079118 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-7eb43687-ba63-4ac5-a0e6-f7fd66223baa admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "swap": 0, "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:27.096865 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-7eb43687-ba63-4ac5-a0e6-f7fd66223baa admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.068532 Feb 21 04:07:27.097415 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 17/34] 10.222.0.10 () {64 vars in 1282 bytes} [Mon Feb 21 04:07:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:07:27.109588 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-440bb9c2-917f-4db3-9dbb-555caeb85ae4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:27.143562 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-440bb9c2-917f-4db3-9dbb-555caeb85ae4 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038130 Feb 21 04:07:27.144248 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 18/35] 10.222.0.10 () {64 vars in 1332 bytes} [Mon Feb 21 04:07:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:07:53.696730 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-7eb43687-ba63-4ac5-a0e6-f7fd66223baa admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:53.697727 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-7eb43687-ba63-4ac5-a0e6-f7fd66223baa admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Feb 21 04:07:53.698121 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 18/36] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:07:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:53.754501 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-184e39f4-746e-4c8e-a783-439ae08e22a6 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:53.771601 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-184e39f4-746e-4c8e-a783-439ae08e22a6 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067069 Feb 21 04:07:53.772132 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 19/37] 10.222.0.10 () {60 vars in 1291 bytes} [Mon Feb 21 04:07:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:07:55.137315 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-7eb43687-ba63-4ac5-a0e6-f7fd66223baa admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:55.138313 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-7eb43687-ba63-4ac5-a0e6-f7fd66223baa admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Feb 21 04:07:55.138713 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 19/38] 10.222.0.10 () {56 vars in 1074 bytes} [Mon Feb 21 04:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:55.345272 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-b5b42d65-1cd8-4a9e-bc4b-8535e4f5acb3 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:55.350717 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.wsgi [None req-b5b42d65-1cd8-4a9e-bc4b-8535e4f5acb3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 21 04:07:55.351231 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-b5b42d65-1cd8-4a9e-bc4b-8535e4f5acb3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:07:55.352019 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-b5b42d65-1cd8-4a9e-bc4b-8535e4f5acb3 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056299 Feb 21 04:07:55.352526 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 20/39] 10.222.0.10 () {60 vars in 1190 bytes} [Mon Feb 21 04:07:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 04:07:55.361760 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-d663be5c-b7a6-47f4-aedf-3d075fa7562a admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:55.381548 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-d663be5c-b7a6-47f4-aedf-3d075fa7562a admin admin] 10.222.0.10 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023278 Feb 21 04:07:55.382071 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 20/40] 10.222.0.10 () {60 vars in 1210 bytes} [Mon Feb 21 04:07:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:07:55.391772 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-e7599bf7-71fa-43bd-a6ac-202bdd70d212 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:55.413068 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-e7599bf7-71fa-43bd-a6ac-202bdd70d212 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024663 Feb 21 04:07:55.413607 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 21/41] 10.222.0.10 () {60 vars in 1210 bytes} [Mon Feb 21 04:07:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:07:55.422484 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-26dd1651-a973-490c-83e9-ed4a97162210 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:55.427776 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.wsgi [None req-26dd1651-a973-490c-83e9-ed4a97162210 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 21 04:07:55.428332 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-26dd1651-a973-490c-83e9-ed4a97162210 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:07:55.429150 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-26dd1651-a973-490c-83e9-ed4a97162210 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010125 Feb 21 04:07:55.429633 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 21/42] 10.222.0.10 () {60 vars in 1190 bytes} [Mon Feb 21 04:07:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 21 04:07:56.691972 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-e7599bf7-71fa-43bd-a6ac-202bdd70d212 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:56.693023 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-e7599bf7-71fa-43bd-a6ac-202bdd70d212 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Feb 21 04:07:56.693420 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 22/43] 10.222.0.10 () {56 vars in 1074 bytes} [Mon Feb 21 04:07:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:56.879965 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-f777363e-a5ab-4945-b7f7-58e2b88952ff admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:56.885547 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.wsgi [None req-f777363e-a5ab-4945-b7f7-58e2b88952ff admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 21 04:07:56.886099 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-f777363e-a5ab-4945-b7f7-58e2b88952ff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:07:56.886903 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-f777363e-a5ab-4945-b7f7-58e2b88952ff admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057083 Feb 21 04:07:56.887395 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 22/44] 10.222.0.10 () {60 vars in 1190 bytes} [Mon Feb 21 04:07:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 04:07:56.896462 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-892fb8f3-ed65-4409-b4c1-3ed59832425a admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:56.909970 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-892fb8f3-ed65-4409-b4c1-3ed59832425a admin admin] 10.222.0.10 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016965 Feb 21 04:07:56.910430 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 23/45] 10.222.0.10 () {60 vars in 1210 bytes} [Mon Feb 21 04:07:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:07:56.919720 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-0ae501b0-05fe-46a6-901b-94c03c769bb7 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:56.932653 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-0ae501b0-05fe-46a6-901b-94c03c769bb7 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016688 Feb 21 04:07:56.933169 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 23/46] 10.222.0.10 () {60 vars in 1210 bytes} [Mon Feb 21 04:07:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:07:56.942722 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-98809acc-77a6-4f00-818e-01fe21f60ec1 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:56.948211 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.wsgi [None req-98809acc-77a6-4f00-818e-01fe21f60ec1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 21 04:07:56.948799 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-98809acc-77a6-4f00-818e-01fe21f60ec1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:07:56.949572 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-98809acc-77a6-4f00-818e-01fe21f60ec1 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010369 Feb 21 04:07:56.950073 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 24/47] 10.222.0.10 () {60 vars in 1190 bytes} [Mon Feb 21 04:07:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 21 04:07:58.227483 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-0ae501b0-05fe-46a6-901b-94c03c769bb7 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:58.228484 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-0ae501b0-05fe-46a6-901b-94c03c769bb7 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Feb 21 04:07:58.228921 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 24/48] 10.222.0.10 () {56 vars in 1074 bytes} [Mon Feb 21 04:07:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:58.415332 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-62a97428-1418-45ac-b44e-ce703fd6386d admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:58.420964 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.wsgi [None req-62a97428-1418-45ac-b44e-ce703fd6386d admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 21 04:07:58.421515 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-62a97428-1418-45ac-b44e-ce703fd6386d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:07:58.422282 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-62a97428-1418-45ac-b44e-ce703fd6386d admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056504 Feb 21 04:07:58.422779 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 25/49] 10.222.0.10 () {60 vars in 1193 bytes} [Mon Feb 21 04:07:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 04:07:58.431850 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-102338ed-0367-4ab6-9cd0-64bb71700cca admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:58.445572 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-102338ed-0367-4ab6-9cd0-64bb71700cca admin admin] 10.222.0.10 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017181 Feb 21 04:07:58.446084 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 25/50] 10.222.0.10 () {60 vars in 1210 bytes} [Mon Feb 21 04:07:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:07:58.455174 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:58.467763 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016326 Feb 21 04:07:58.468266 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 26/51] 10.222.0.10 () {60 vars in 1210 bytes} [Mon Feb 21 04:07:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:07:58.477111 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-8a14ff4a-e28f-41c9-8145-2ea4e3e84d5a admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:58.482714 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.wsgi [None req-8a14ff4a-e28f-41c9-8145-2ea4e3e84d5a admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 21 04:07:58.483273 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-8a14ff4a-e28f-41c9-8145-2ea4e3e84d5a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:07:58.484047 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-8a14ff4a-e28f-41c9-8145-2ea4e3e84d5a admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010470 Feb 21 04:07:58.484535 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 26/52] 10.222.0.10 () {60 vars in 1193 bytes} [Mon Feb 21 04:07:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 21 04:07:59.750847 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:07:59.751892 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Feb 21 04:07:59.752286 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 27/53] 10.222.0.10 () {56 vars in 1074 bytes} [Mon Feb 21 04:07:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:07:59.942178 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-7d72d2f5-d810-4d4b-bbd7-754b55d601f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:07:59.961777 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-7d72d2f5-d810-4d4b-bbd7-754b55d601f7 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069573 Feb 21 04:07:59.962242 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 27/54] 10.222.0.10 () {64 vars in 1235 bytes} [Mon Feb 21 04:07:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:08:01.217205 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:08:01.218185 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Feb 21 04:08:01.218581 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 28/55] 10.222.0.10 () {56 vars in 1074 bytes} [Mon Feb 21 04:08:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:08:01.407094 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-206adbb2-d015-4d65-9f5f-87c841c431a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:08:01.423744 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-206adbb2-d015-4d65-9f5f-87c841c431a7 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067717 Feb 21 04:08:01.424270 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 28/56] 10.222.0.10 () {64 vars in 1235 bytes} [Mon Feb 21 04:08:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 04:08:02.717632 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:08:02.718665 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Feb 21 04:08:02.719059 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 29/57] 10.222.0.10 () {56 vars in 1074 bytes} [Mon Feb 21 04:08:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:08:02.909280 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-c78064ec-21e8-4f46-bb1c-dbd9dad4bfa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:08:02.926669 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-c78064ec-21e8-4f46-bb1c-dbd9dad4bfa2 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067733 Feb 21 04:08:02.927194 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 29/58] 10.222.0.10 () {64 vars in 1235 bytes} [Mon Feb 21 04:08:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 04:08:04.197753 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:08:04.198742 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Feb 21 04:08:04.199738 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 30/59] 10.222.0.10 () {56 vars in 1074 bytes} [Mon Feb 21 04:08:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:08:04.388715 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-28d3c2d1-6e8e-4b0a-b95e-c8abdc893889 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:08:04.406282 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-28d3c2d1-6e8e-4b0a-b95e-c8abdc893889 admin admin] 10.222.0.10 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067482 Feb 21 04:08:04.406824 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 30/60] 10.222.0.10 () {64 vars in 1235 bytes} [Mon Feb 21 04:08:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 04:08:05.717738 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:08:05.718730 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Feb 21 04:08:05.719133 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 31/61] 10.222.0.10 () {56 vars in 1074 bytes} [Mon Feb 21 04:08:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:08:05.906730 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-2bac4411-6b40-4387-80dc-e524ad3968c4 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:08:05.925955 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-2bac4411-6b40-4387-80dc-e524ad3968c4 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068682 Feb 21 04:08:05.926527 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 31/62] 10.222.0.10 () {60 vars in 1202 bytes} [Mon Feb 21 04:08:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:08:56.035307 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:08:56.036299 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-7cd9927d-6413-4478-8aa4-fcaeb8c01a76 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Feb 21 04:08:56.036717 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 32/63] 10.222.0.10 () {54 vars in 930 bytes} [Mon Feb 21 04:08:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:08:56.093988 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-e2a1507d-ab7d-4516-9b15-bec4e4e22c59 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:08:56.112467 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-e2a1507d-ab7d-4516-9b15-bec4e4e22c59 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069264 Feb 21 04:08:56.113018 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 32/64] 10.222.0.10 () {60 vars in 1291 bytes} [Mon Feb 21 04:08:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:08:56.134304 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-7a49792b-5126-4ca3-bd92-aeee6daee03c admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:08:56.142425 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-7a49792b-5126-4ca3-bd92-aeee6daee03c admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011752 Feb 21 04:08:56.142935 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 33/65] 10.222.0.10 () {60 vars in 1282 bytes} [Mon Feb 21 04:08:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:08:56.154607 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-2fbaeb50-6161-4ada-af66-33e81807d435 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:08:56.162080 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-2fbaeb50-6161-4ada-af66-33e81807d435 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011840 Feb 21 04:08:56.162594 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 33/66] 10.222.0.10 () {60 vars in 1285 bytes} [Mon Feb 21 04:08:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:08:56.173214 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-f0b64654-3d3f-4d6a-9004-e29d148c3692 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:08:56.180620 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-f0b64654-3d3f-4d6a-9004-e29d148c3692 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010857 Feb 21 04:08:56.181153 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 34/67] 10.222.0.10 () {60 vars in 1285 bytes} [Mon Feb 21 04:08:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:08:56.191579 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-6585bb5c-f717-4aad-8a8d-e4b3241175b2 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:08:56.199332 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-6585bb5c-f717-4aad-8a8d-e4b3241175b2 admin admin] 10.222.0.10 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011131 Feb 21 04:08:56.199835 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 34/68] 10.222.0.10 () {60 vars in 1282 bytes} [Mon Feb 21 04:08:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:10:33.271412 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-f117c209-99fb-4063-9224-ea22706ff51a tempest-verify_tempest_config-997317200 tempest-verify_tempest_config-997317200-project] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:10:33.273451 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-f117c209-99fb-4063-9224-ea22706ff51a tempest-verify_tempest_config-997317200 tempest-verify_tempest_config-997317200-project] 10.222.0.10 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.117754 Feb 21 04:10:33.273972 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 35/69] 10.222.0.10 () {58 vars in 1133 bytes} [Mon Feb 21 04:10:33 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:12:04.616691 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-6585bb5c-f717-4aad-8a8d-e4b3241175b2 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:12:04.617728 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-6585bb5c-f717-4aad-8a8d-e4b3241175b2 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Feb 21 04:12:04.618121 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 35/70] 10.222.0.10 () {56 vars in 1074 bytes} [Mon Feb 21 04:12:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:12:04.883304 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-65fb3233-74b0-48e5-9424-66ba889a8e02 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:12:04.884486 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:12:04.884486 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: warnings.warn(msg) Feb 21 04:12:04.886015 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-65fb3233-74b0-48e5-9424-66ba889a8e02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:12:04.886452 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-65fb3233-74b0-48e5-9424-66ba889a8e02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:12:04.887236 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-65fb3233-74b0-48e5-9424-66ba889a8e02 admin admin] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:12:04.887657 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-65fb3233-74b0-48e5-9424-66ba889a8e02 admin admin] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:12:04.922104 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-65fb3233-74b0-48e5-9424-66ba889a8e02 admin admin] 10.222.0.10 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.166661 Feb 21 04:12:04.922631 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 36/71] 10.222.0.10 () {60 vars in 1193 bytes} [Mon Feb 21 04:12:04 2022] GET /compute/v2.1/os-services => generated 794 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:12:06.224117 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-6585bb5c-f717-4aad-8a8d-e4b3241175b2 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:12:06.225157 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-6585bb5c-f717-4aad-8a8d-e4b3241175b2 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Feb 21 04:12:06.225553 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 36/72] 10.222.0.10 () {56 vars in 1074 bytes} [Mon Feb 21 04:12:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:12:06.415115 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-da4bba75-711b-491f-ac2d-6293d39e6b95 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:12:06.416285 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:12:06.416285 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: warnings.warn(msg) Feb 21 04:12:06.417872 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-da4bba75-711b-491f-ac2d-6293d39e6b95 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:12:06.418314 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-da4bba75-711b-491f-ac2d-6293d39e6b95 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:12:06.419115 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-da4bba75-711b-491f-ac2d-6293d39e6b95 admin admin] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:12:06.419541 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-da4bba75-711b-491f-ac2d-6293d39e6b95 admin admin] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:12:06.438334 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-da4bba75-711b-491f-ac2d-6293d39e6b95 admin admin] 10.222.0.10 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075727 Feb 21 04:12:06.438871 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 37/73] 10.222.0.10 () {60 vars in 1193 bytes} [Mon Feb 21 04:12:06 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:12:18.239855 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-6585bb5c-f717-4aad-8a8d-e4b3241175b2 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:12:18.240883 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-6585bb5c-f717-4aad-8a8d-e4b3241175b2 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Feb 21 04:12:18.241306 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 37/74] 10.222.0.10 () {56 vars in 1074 bytes} [Mon Feb 21 04:12:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:12:18.457816 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-eda70a63-656f-4a56-9462-e180cbcf5231 admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:12:18.458975 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:12:18.458975 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: warnings.warn(msg) Feb 21 04:12:18.460499 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-eda70a63-656f-4a56-9462-e180cbcf5231 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:12:18.460998 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-eda70a63-656f-4a56-9462-e180cbcf5231 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:12:18.461809 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-eda70a63-656f-4a56-9462-e180cbcf5231 admin admin] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:12:18.462233 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-eda70a63-656f-4a56-9462-e180cbcf5231 admin admin] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:12:18.486533 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-eda70a63-656f-4a56-9462-e180cbcf5231 admin admin] 10.222.0.10 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078381 Feb 21 04:12:18.487561 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 38/75] 10.222.0.10 () {60 vars in 1193 bytes} [Mon Feb 21 04:12:18 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:12:19.761333 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: DEBUG nova.api.openstack.wsgi [None req-6585bb5c-f717-4aad-8a8d-e4b3241175b2 admin admin] Calling method '>' {{(pid=102159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:12:19.762342 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: INFO nova.api.openstack.requestlog [None req-6585bb5c-f717-4aad-8a8d-e4b3241175b2 admin admin] 10.222.0.10 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Feb 21 04:12:19.762768 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: [pid: 102159|app: 0|req: 38/76] 10.222.0.10 () {56 vars in 1074 bytes} [Mon Feb 21 04:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:12:19.955158 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG nova.api.openstack.wsgi [None req-b29d1254-60f8-4134-a1c8-e163795fcaae admin admin] Calling method '>' {{(pid=102160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:12:19.956847 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:12:19.956847 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: warnings.warn(msg) Feb 21 04:12:19.958371 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-b29d1254-60f8-4134-a1c8-e163795fcaae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:12:19.958856 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-b29d1254-60f8-4134-a1c8-e163795fcaae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:12:19.959641 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-b29d1254-60f8-4134-a1c8-e163795fcaae admin admin] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:12:19.960061 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: DEBUG oslo_concurrency.lockutils [None req-b29d1254-60f8-4134-a1c8-e163795fcaae admin admin] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:12:19.981265 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: INFO nova.api.openstack.requestlog [None req-b29d1254-60f8-4134-a1c8-e163795fcaae admin admin] 10.222.0.10 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079535 Feb 21 04:12:19.981744 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: [pid: 102160|app: 0|req: 39/77] 10.222.0.10 () {60 vars in 1193 bytes} [Mon Feb 21 04:12:19 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:13:16.672399 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: Mon Feb 21 04:13:16 2022 - graceful shutdown triggered... Feb 21 04:13:16.672347 dv-cinder-773985-36-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 21 04:13:16.673449 dv-cinder-773985-36-iscsi devstack@n-api.service[102159]: Gracefully killing worker 1 (pid: 102159)... Feb 21 04:13:16.673819 dv-cinder-773985-36-iscsi devstack@n-api.service[102160]: Gracefully killing worker 2 (pid: 102160)... Feb 21 04:13:17.673388 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: worker 1 buried after 1 seconds Feb 21 04:13:17.673388 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: worker 2 buried after 1 seconds Feb 21 04:13:17.673388 dv-cinder-773985-36-iscsi devstack@n-api.service[102158]: goodbye to uWSGI. Feb 21 04:13:17.675291 dv-cinder-773985-36-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 21 04:13:17.675864 dv-cinder-773985-36-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 21 04:13:17.678617 dv-cinder-773985-36-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 21 04:13:17.695325 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 21 04:13:17.698010 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 04:13:17 2022] *** Feb 21 04:13:17.698010 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 04:13:17.698010 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 04:13:17.698010 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: nodename: dv-cinder-773985-36-iscsi Feb 21 04:13:17.698010 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: machine: x86_64 Feb 21 04:13:17.698010 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: clock source: unix Feb 21 04:13:17.698010 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: pcre jit disabled Feb 21 04:13:17.698010 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: detected number of CPU cores: 4 Feb 21 04:13:17.698582 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: current working directory: / Feb 21 04:13:17.698582 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: detected binary path: /usr/bin/uwsgi-core Feb 21 04:13:17.698582 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: your processes number limit is 47680 Feb 21 04:13:17.698582 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: your memory page size is 4096 bytes Feb 21 04:13:17.698582 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: detected max file descriptor number: 2048 Feb 21 04:13:17.698582 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: lock engine: pthread robust mutexes Feb 21 04:13:17.698582 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: thunder lock: enabled Feb 21 04:13:17.698582 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 21 04:13:17.698582 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 04:13:17.744981 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: Python main interpreter initialized at 0x5628c4daf9c0 Feb 21 04:13:17.744981 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: python threads support enabled Feb 21 04:13:17.744981 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: your server socket listen backlog is limited to 100 connections Feb 21 04:13:17.744981 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: your mercy for graceful operations on workers is 90 seconds Feb 21 04:13:17.745415 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 04:13:17.745415 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: *** Operational MODE: preforking *** Feb 21 04:13:17.745704 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: *** uWSGI is running in multiple interpreter mode *** Feb 21 04:13:17.745704 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: spawned uWSGI master process (pid: 116549) Feb 21 04:13:17.745910 dv-cinder-773985-36-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 21 04:13:17.746783 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: spawned uWSGI worker 1 (pid: 116570, cores: 1) Feb 21 04:13:17.748259 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: spawned uWSGI worker 2 (pid: 116571, cores: 1) Feb 21 04:13:17.748259 dv-cinder-773985-36-iscsi devstack@n-api.service[116549]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 04:13:19.662836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 04:13:19.662836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: from cryptography.utils import int_from_bytes Feb 21 04:13:19.663562 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 04:13:19.663562 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: from cryptography.utils import int_from_bytes Feb 21 04:13:19.695169 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 04:13:19.695169 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: from cryptography.utils import int_from_bytes Feb 21 04:13:19.695801 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 04:13:19.695801 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: from cryptography.utils import int_from_bytes Feb 21 04:13:22.047649 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 04:13:22.048220 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 04:13:22.048512 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 04:13:22.048796 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 04:13:22.049066 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 04:13:22.049475 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.049814 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.050147 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.050477 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.050824 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.051152 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.051492 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.051825 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.052165 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.052436 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.052800 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.053139 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773985-36-iscsi {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.053474 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.053794 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.054114 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.054444 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.054757 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.055091 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.055424 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.055940 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.057427 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.057427 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.057427 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.057712 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.058016 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.058337 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.058672 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.058991 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.059328 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.059651 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.060097 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773985-36-iscsi {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.060405 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.060756 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.061090 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.061529 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.061854 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.062167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.062496 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.062833 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.063156 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.063486 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.063813 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.064173 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.064507 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.064850 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.065172 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.065488 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.065818 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.066135 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.066452 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.066710 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.067033 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.067361 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.067689 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.068025 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.068282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.068539 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.068893 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.069227 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.069545 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.069861 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.070179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.070495 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.070807 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.071123 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.071444 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.071761 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.072091 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.072416 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.072774 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.073092 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.073423 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.073841 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.074099 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.074418 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.074772 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.075098 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.075413 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.075740 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.076072 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.076389 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.076737 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.077065 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.077385 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.078103 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.078437 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.078701 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.079038 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.079363 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.079698 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.080557 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.080909 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.081226 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.081538 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.081865 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.082185 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.082504 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.082821 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.083144 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.083459 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.083776 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.084095 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.084411 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.084777 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.085109 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.085423 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.085740 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.086056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.086372 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.086700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.087018 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.087332 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.087680 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.087981 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.088293 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.088619 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.088959 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.089275 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.089602 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.089912 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.090227 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.090553 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.090869 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.091182 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.091494 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.091811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.092124 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.092439 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.092781 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.093099 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.093408 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.093738 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.094068 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.094384 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.094704 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.095016 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.095344 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.096282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.096625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.097032 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.097356 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.097678 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.098020 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.098356 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.098671 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.098992 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.099328 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.099649 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.099967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.100285 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.100611 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.100960 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.101301 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.101634 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.101964 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.102293 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.102613 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.105640 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.105640 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.105640 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.105640 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.105640 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.105640 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.105640 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.105640 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.106820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.106820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.106820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.106820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.106820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.107622 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.107622 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.107928 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.108100 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.109175 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.109175 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.109175 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.109625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.109625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.109921 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.110221 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.110737 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.111098 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.111420 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.111744 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.112245 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.112562 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.112916 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.113229 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.113548 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.113861 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.114197 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.114536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.114850 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.115195 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.115509 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.115828 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.116141 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.116459 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.116798 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.117122 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.117443 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.117758 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.118090 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.118704 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.118704 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.119076 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.120157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.120157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.120157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.121010 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.121010 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.121010 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.121739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.121739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.122073 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.122220 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.122467 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.122805 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.123121 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.123457 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.123791 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.124152 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.124421 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.124762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.125076 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.125388 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.125701 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.126019 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.126330 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.126705 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.127029 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.127341 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.127654 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.127987 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.128305 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.128624 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.128969 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.129261 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.129695 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.131160 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.131160 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.131160 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.131160 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.132983 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.132983 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.132983 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.132983 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.132983 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.132983 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.133836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.133836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.133836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.134370 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.134370 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.134666 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.134925 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.135253 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.135565 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.135887 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.136231 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.136571 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.136934 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.137267 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.137584 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.137906 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.138225 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.138543 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.139012 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.139182 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.139492 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.139827 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.140167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.140436 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.140788 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.141108 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.141468 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.141743 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.142063 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.142919 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.143258 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.143576 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.143896 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.144223 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.144538 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.144881 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.145198 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.145510 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.145822 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.146138 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.146459 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.146776 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.147093 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.147403 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.147723 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.148037 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.148347 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.148670 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.149123 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.149317 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.149634 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.149965 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.150279 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.150586 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.150896 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.151223 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.151609 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.151840 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.152148 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.152462 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.153445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.153445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.153749 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.153999 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.154325 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.154641 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.154963 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.155279 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.155594 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.155920 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.156238 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.156551 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.156896 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.157216 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.157535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.157867 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.158738 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.159056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.159355 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.159673 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.160093 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.160297 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.160592 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.161200 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.161541 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.161869 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.162193 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.162528 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.162856 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.163197 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.163533 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.163882 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.164197 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.164515 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.164855 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.165170 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.166009 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.166009 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.166332 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.166494 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.166679 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.166989 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.167298 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.167709 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.167903 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.168226 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.168539 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.168885 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.169201 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.169536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.169836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.170243 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.170573 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.170892 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.171086 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.171396 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.171746 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.172085 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.172438 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.172779 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.173089 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.173421 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.173767 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.174079 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.174390 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.174707 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.175021 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.175331 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.175649 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.175968 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.176285 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.176601 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.176966 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.177254 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.177565 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.177887 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.178203 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.178514 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.178823 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.179138 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.179782 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.179782 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.180094 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.180449 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.180733 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.181738 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.181738 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.181738 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.182339 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.182339 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.182657 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.182818 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.183096 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.183407 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.183815 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.184033 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.184343 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.185196 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.185196 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.185524 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.185689 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.185910 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.186225 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.186536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.186846 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.187157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.187471 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.187779 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.188086 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.188393 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.188726 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.189037 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.189431 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.189706 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.190016 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.190425 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.190636 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.190986 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.191305 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.191655 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.191967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.192295 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.192624 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.192971 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.193294 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.193616 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.193954 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.194245 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.194564 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.194886 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.195198 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.195509 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.195844 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.196159 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.196479 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.196844 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.197176 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.197508 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.197820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.198137 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.198446 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.198758 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.199074 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.199390 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.199710 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.200032 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.200349 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.200691 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.201015 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.201416 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.201674 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.201942 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.202261 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.202623 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.202905 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.203218 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.203536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.203850 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.204171 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.204482 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.205481 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.205802 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.206123 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.206438 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.206759 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.207078 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.207404 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.207727 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.208043 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.208532 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.208808 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.209129 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.209449 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.209851 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.210104 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.210376 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.210709 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.211075 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.211322 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.211647 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.211950 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.212263 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.212590 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.213045 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.213367 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.213682 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.214105 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.214425 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.214746 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.215077 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.215407 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.215739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.216051 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.216371 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.216712 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.217043 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.217373 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.217693 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.218016 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.218328 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.218660 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.218988 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.219308 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.219636 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.220061 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.221140 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.221291 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.221622 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.221957 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.222271 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.222586 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.222912 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.223225 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.223538 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.223867 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.224179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.224499 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.224842 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.225161 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.225472 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.225782 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.226109 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.226418 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.226746 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.227067 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.227395 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.227723 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.228035 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.228364 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.228698 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.229014 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.229323 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.229633 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.229988 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.230300 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.230626 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.230959 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.231296 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.231611 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.231951 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.232283 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.232605 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.233027 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.233358 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.233710 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.233967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.234276 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.234581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.235016 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.235344 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.235744 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.236140 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.236501 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.236865 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.237271 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.237605 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.238035 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.238354 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.238670 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.238982 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.239294 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.239645 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.239959 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.240303 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.240668 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.240991 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.241454 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.241648 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.241981 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.242304 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.242625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.242953 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.243276 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.243599 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.243920 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.244243 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.244559 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.244914 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.245236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.245560 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.246122 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.246459 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.246780 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.247100 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.247418 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.247740 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.248062 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.248380 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.248721 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.249041 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.249358 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.249697 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.250024 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.250357 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.250700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.251022 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.251343 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.252183 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.252491 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.252882 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.253213 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.253532 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.253848 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.254170 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.254491 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.254811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.255131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.255450 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.255774 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.256090 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.256407 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.256752 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.257076 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.257418 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.257753 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.258082 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.258404 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.258729 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.259056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.259578 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.259899 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.260241 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.260572 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.261345 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.261345 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.261688 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.261895 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.262280 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.262525 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.262843 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.263166 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.263480 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.263811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.264131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.264445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.264798 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.265118 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.265659 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.266021 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.266348 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.266682 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.267017 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.267873 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.268195 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.268556 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.268902 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.269220 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.269545 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.269865 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.270178 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.270497 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.270817 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.271132 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.271444 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.271766 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.272076 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.272412 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.272748 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.273064 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.273382 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.273704 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.274017 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.274327 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.274640 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.274953 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.275108 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 04:13:22.275552 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.275652 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 04:13:22.275741 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.275870 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 04:13:22.276026 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.276178 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.276271 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 04:13:22.276488 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 04:13:22.276579 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.276824 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.276926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.277143 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.277237 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.277505 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.277596 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.277836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.278273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.278412 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.278505 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.278724 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.278824 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.279047 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.279162 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.279365 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.279457 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.279695 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.279795 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.279958 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.280049 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.280281 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.280380 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.280617 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773985-36-iscsi {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.280743 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.280965 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.281058 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.281281 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.281536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.281628 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.281889 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.281998 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.282211 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.282309 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.282544 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.282654 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.282882 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.282988 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.283219 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.283416 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.283521 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.283737 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.283842 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.284051 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.284151 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.284370 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.284462 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.284740 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.284850 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.285067 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.285158 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.285384 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.285484 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.285712 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.285805 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.286030 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.286127 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.286350 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.286450 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.286665 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.286762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.286979 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.287070 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773985-36-iscsi {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.287296 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.287402 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.287614 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.287707 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.287936 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.288034 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.288285 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.288389 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.288612 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.288731 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.288960 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.289052 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.289285 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.289378 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.289608 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.289708 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.289925 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.290017 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.290243 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.290336 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.290559 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.290674 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.290876 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.290989 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.291197 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.291298 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.291518 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.291616 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.291838 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.291957 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.292150 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.292259 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.292472 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.292578 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.292812 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.292926 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.293121 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.293221 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.293379 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.293554 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.293695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.293874 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.294025 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.294205 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.294357 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.294537 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.294685 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.294859 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.294961 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.295187 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.295277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.295504 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.295605 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.295828 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.295918 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.296658 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.296783 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.296883 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.296977 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.297063 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.297220 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.297310 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.297401 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.297502 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.297597 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.297814 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.297913 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.298090 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.298191 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.298408 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.298517 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.298763 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.298864 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.299086 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.299180 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.299418 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.299510 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.299736 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.299834 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.300061 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.300165 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.300375 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.300466 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.300728 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.300825 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.301060 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.301216 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.301379 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.301472 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.301697 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.301790 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.302027 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.302181 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.302346 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.302441 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.302652 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.302818 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.302957 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.303056 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.303274 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.303366 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.303591 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.303688 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.303910 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.304003 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.304245 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.304338 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.304556 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.304712 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.304820 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.304909 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.305135 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.305227 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.305449 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.305541 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.305776 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.305875 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.306092 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.306192 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.306409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.306500 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.306724 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.306816 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.307033 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.307126 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.307349 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.307581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.307669 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.307753 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.307973 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.308074 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.308289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.308388 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.308603 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.308763 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.308937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.309029 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.309252 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.309353 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.309566 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.309659 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.309879 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.309972 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.310204 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.310309 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.310533 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.310626 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.310846 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.310944 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.311160 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.311260 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.311478 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.311569 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.311792 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.311893 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.312120 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.312212 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.312435 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.312525 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.312735 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 04:13:22.312824 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.313094 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.313405 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.313717 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.314043 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.314872 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.315187 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.315514 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.315823 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.316136 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.316463 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.316802 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.317117 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.317430 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.317742 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.318052 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.318368 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.318680 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.318993 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.319297 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.319622 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.319951 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.320266 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.320580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.320918 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.321245 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 04:13:22.321586 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.321924 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.322273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.322595 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.322936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.323278 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.323602 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.323920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.324242 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.324575 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.324920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.325240 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.325560 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.325889 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.326217 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.326554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.326879 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.327202 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.327532 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.327853 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.328179 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.328521 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.328881 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.329201 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.329549 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.330492 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.330816 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.331150 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.331665 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.331804 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.332134 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.332424 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.332783 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.333134 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.333456 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.333782 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.334105 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.334428 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.334749 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.335074 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.335394 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.335743 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.336067 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.336298 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_db.sqlalchemy.engines [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:13:22.336400 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.336723 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.337051 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.337373 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.337694 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.338016 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.338334 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.338652 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.338965 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.339284 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.339598 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.339926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.340263 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.340578 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.340944 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.341260 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.341581 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.341900 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.342218 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.342535 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.342857 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.343218 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.343485 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.343817 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.344136 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.344451 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.344808 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.345124 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.345465 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.345790 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.346111 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.346432 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.346752 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.347073 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.347405 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.347726 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.348048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.348398 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.348758 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.349073 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.349406 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.349740 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.350063 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.350378 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.350695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.351009 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.351324 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.351635 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.351953 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.352264 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.352578 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.352927 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.353219 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.353530 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.353863 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.354180 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.354491 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.354803 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.355116 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.355469 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.355783 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.356318 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.356470 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.356820 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.357156 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.357478 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.357801 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.358119 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.358444 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.358763 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.359082 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.359411 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.359733 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.360060 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.360378 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.360732 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.361078 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.361407 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.361721 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.362043 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.362390 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.362732 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.363058 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.363385 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.363703 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.364025 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.364340 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.364674 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.364994 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.365311 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.365638 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.365959 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.366283 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.366600 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.366929 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.367252 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.367578 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.367889 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.368213 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.368556 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.369445 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.369445 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.369616 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.369863 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.370181 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.370502 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.370824 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.371138 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.371452 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.371773 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.372096 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.372415 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.372759 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.373167 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.373398 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.373713 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.374026 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.374339 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.374660 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.374994 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.375315 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.375645 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.375973 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.376289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.377137 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.377457 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.377776 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.378090 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.378407 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.378721 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.379073 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.379393 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.379707 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.380034 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.380364 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.380711 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.381036 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.381354 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.381672 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.382003 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.382325 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.382641 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.382962 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.383276 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.383593 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.383913 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.384245 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.384562 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.384908 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.385229 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.385540 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.385862 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.386185 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.386770 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.387107 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.387524 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.387759 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.388087 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.388421 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.388793 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.389131 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.389485 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.389799 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.390118 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.390429 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.390742 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.391060 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.391372 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.391684 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.391996 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.392964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.393268 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.393584 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.393895 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.394208 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.394531 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.394843 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.395163 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.395475 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.395880 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.396125 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.396436 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.396769 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.397082 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.397433 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.397746 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.398089 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.398429 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.398782 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.399095 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.399407 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.399737 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.400047 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.400328 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.context [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5698d2f8-fc88-4d55-adc3-7e1555697e28(cell1) {{(pid=116571) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 04:13:22.400500 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.400665 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.400981 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.401296 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.401606 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.401926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.402247 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.402567 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.403175 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.403442 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.403759 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.404068 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.404388 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.404730 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.404881 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:13:22.405042 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.405354 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.405671 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.405986 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.406288 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.406437 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:13:22.406606 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.406916 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.407155 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:13:22.407295 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.407533 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.407859 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.408177 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.408499 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.408838 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.409140 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:13:22.409282 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.409468 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.409787 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.410098 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.410411 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.410724 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.411032 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.411342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.411658 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.411987 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.412310 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.412621 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.412961 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.413281 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.413580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.413892 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.414209 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.414517 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.414827 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.415135 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.415444 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.415754 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.416093 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.416395 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.416733 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.417035 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.417344 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.417697 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.418015 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.418378 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.418697 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.419021 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.419349 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.419671 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.419992 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.420114 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_db.sqlalchemy.engines [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:13:22.420315 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.420638 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.420971 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.421290 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.421429 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_db.sqlalchemy.engines [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:13:22.421613 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.421927 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.422240 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.422574 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.422897 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.423218 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.424206 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.424206 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.424206 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.424621 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.424856 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.425172 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.425566 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.426107 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.426664 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.427266 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.427873 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.428475 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.429090 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.429719 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.430321 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.430891 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.431464 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.431980 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.432371 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.432791 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.433129 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.433558 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.433918 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.434319 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.434629 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.435089 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.435448 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.435877 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.436227 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.436563 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.436920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.437257 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.437593 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.437915 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.438350 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.438681 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.439007 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.439852 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.440174 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.440490 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.440847 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.441184 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.441502 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.441816 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.442133 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.442470 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.442786 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.443120 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.443547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.443870 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.444183 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.445025 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.445025 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.445292 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.445591 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.445923 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.446258 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.446574 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.446897 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.447216 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.447550 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.447883 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.448206 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.448532 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.448866 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.449209 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.449545 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.449869 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.450202 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.450625 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.450961 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.451280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.451613 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.451951 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.452265 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.452580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.452924 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.453240 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.453554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.453891 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.454205 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.454526 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.455451 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.455775 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.456089 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.456406 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.456765 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.457079 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.457414 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.457738 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.458069 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.458402 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.458719 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.459056 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.459375 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.459691 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.460003 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.460314 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.460695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.461015 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.461344 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.461684 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.462023 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.462341 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.462685 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.463023 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.463349 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.463676 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.464012 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.464322 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.464658 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.464972 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.465288 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.465601 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.465910 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.466226 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.466535 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.466844 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.467149 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.467480 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.467791 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.468121 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.468437 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.468773 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.469087 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.469396 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.469750 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.470061 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.470442 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.470775 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.471109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.471445 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.471764 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.472094 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.472420 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.472770 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.473096 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.473420 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.473744 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.474071 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.474393 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.474713 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.475039 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.475362 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.475690 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.476254 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.476594 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.476942 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.477263 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.477584 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.477905 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.478227 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.478544 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.478865 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.479181 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.479498 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.479832 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.480160 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.480493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.480862 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.481190 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.481511 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.481832 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.482156 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.482523 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.482845 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.483161 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.483906 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.483906 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.484271 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.484405 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.484743 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.485065 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.485387 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.485749 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.486042 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.486364 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.486685 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.487020 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.487362 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.487692 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.488012 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.488333 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.488678 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.489211 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.489529 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.489871 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.490203 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.490536 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.490863 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.491185 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.491523 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.491836 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.492154 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.492464 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.492811 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.493123 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.493454 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.493772 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.494084 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.494412 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.494727 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.495267 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.495625 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.495950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.496282 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.496615 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.496963 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.497278 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.497609 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.497924 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.498241 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.498553 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.498872 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.499190 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.499501 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.499818 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.500134 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.500444 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.500783 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.501096 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.501428 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.502257 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.502557 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.502866 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.503184 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.503495 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.503805 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.504115 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.504424 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.504770 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.505083 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.505398 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.505708 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.506028 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.506334 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.506647 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.507006 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.507339 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.507647 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.507958 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.508279 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.508595 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.508947 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.509270 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.509586 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.509941 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.510267 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.510807 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.511375 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.511545 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.511795 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.512135 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.512452 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.512789 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.513102 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.513434 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.513754 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.514072 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.514391 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.514710 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.515031 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.515347 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.516704 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.516704 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.516704 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.516704 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.517279 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.517279 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.518183 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.518819 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.518819 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.519109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.519408 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.519691 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.520007 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.520324 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.520684 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.521045 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.521380 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.521714 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.522013 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.522461 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.522754 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.523079 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.523408 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.523727 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.524057 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.524388 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.524728 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.525061 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.525379 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.525718 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.526069 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.526411 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.526819 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.527065 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.527377 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.527689 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.528274 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.528614 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.528983 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.529308 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.529649 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.529967 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.530298 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.530616 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.530948 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.531278 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.531600 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.531944 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.532250 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.532564 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.532976 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.533342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.533665 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.533986 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.534308 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.534646 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.534982 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.535300 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.535633 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.536268 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.536268 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.536595 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.536948 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.537284 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.537604 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.537924 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.538248 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.538569 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.538889 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.539215 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.539546 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.539886 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.540220 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.540557 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.540920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.541277 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.541600 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.541956 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.542297 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.542658 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.542938 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.543253 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 04:13:22.543502 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 04:13:22.568676 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_db.sqlalchemy.engines [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:13:22.578454 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_db.sqlalchemy.engines [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:13:22.633321 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.context [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5698d2f8-fc88-4d55-adc3-7e1555697e28(cell1) {{(pid=116570) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 04:13:22.637758 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:13:22.639444 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:13:22.640265 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:13:22.642462 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:13:22.653277 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_db.sqlalchemy.engines [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:13:22.654286 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_db.sqlalchemy.engines [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:13:22.817607 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_db.sqlalchemy.engines [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 04:13:22.900222 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: WARNING keystonemiddleware.auth_token [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 04:13:22.907273 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: WARNING keystonemiddleware.auth_token [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 04:13:23.151063 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: WARNING keystonemiddleware.auth_token [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 04:13:23.160769 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: WARNING keystonemiddleware.auth_token [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 04:13:23.252772 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: WARNING keystonemiddleware.auth_token [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 04:13:23.258249 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: WARNING keystonemiddleware.auth_token [None req-5e9a2e6f-a0a8-413e-bebf-339aff81fece None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 04:13:23.263803 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5628c4daf9c0 pid: 116571 (default app) Feb 21 04:13:23.513189 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: WARNING keystonemiddleware.auth_token [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 04:13:23.518467 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: WARNING keystonemiddleware.auth_token [None req-a61cdcd2-36c8-4b47-9d34-6e485ea690e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 04:13:23.523802 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5628c4daf9c0 pid: 116570 (default app) Feb 21 04:14:00.598568 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-711824293", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "networks": [{"uuid": "0e926c3e-9f0b-4575-b2e7-0a1f391618f8"}]}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:01.401832 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.network.neutron [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] validate_networks() for [('0e926c3e-9f0b-4575-b2e7-0a1f391618f8', None, None, None, None, None)] {{(pid=116571) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:14:03.678205 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Flavor limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:14:03.678913 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Image limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:14:03.679302 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Flavor pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:14:03.679959 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Image pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:14:03.680833 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:14:03.712979 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:03.713445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:03.715177 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:03.716143 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:03.802327 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Getting quotas for project a0b65910b0574d41970df84e6a1fdbba. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:14:03.812119 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Getting quotas for user 0eea911774944fa2bdb292719f9e2a54 and project a0b65910b0574d41970df84e6a1fdbba. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:14:03.834912 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Going to run 1 instances... {{(pid=116571) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:14:03.846404 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:14:03.846915 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1952317762", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "networks": [{"uuid": "f5e59dc1-d46d-449b-a1f1-2c50b3c1c2c6"}]}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:04.006480 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b6e15a9d-ff82-4cee-b741-452337de7ada tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.310218 Feb 21 04:14:04.009440 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 1/1] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:13:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 4317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:14:04.028378 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-339b28ea-fb50-4be7-981e-88c869f60775 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:04.028378 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-339b28ea-fb50-4be7-981e-88c869f60775 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:04.255445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-339b28ea-fb50-4be7-981e-88c869f60775 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:04.281462 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-339b28ea-fb50-4be7-981e-88c869f60775 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1217 microversion: 2.1 time: 0.264361 Feb 21 04:14:04.282061 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 2/2] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:04 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1217 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:04.813197 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.network.neutron [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] validate_networks() for [('f5e59dc1-d46d-449b-a1f1-2c50b3c1c2c6', None, None, None, None, None)] {{(pid=116570) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:14:05.301464 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f55075ec-4603-4eae-a2f3-0c2c16a90eb3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:05.303041 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f55075ec-4603-4eae-a2f3-0c2c16a90eb3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:05.494248 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-f55075ec-4603-4eae-a2f3-0c2c16a90eb3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:05.518961 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f55075ec-4603-4eae-a2f3-0c2c16a90eb3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1217 microversion: 2.1 time: 0.223933 Feb 21 04:14:05.520407 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 3/3] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:05 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:06.537092 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0511e689-1de1-41d2-af9a-67db57d83f33 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:06.537762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0511e689-1de1-41d2-af9a-67db57d83f33 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:06.549875 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0511e689-1de1-41d2-af9a-67db57d83f33 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:06.556919 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0511e689-1de1-41d2-af9a-67db57d83f33 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:06.558080 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0511e689-1de1-41d2-af9a-67db57d83f33 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:06.558880 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0511e689-1de1-41d2-af9a-67db57d83f33 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:06.985547 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0511e689-1de1-41d2-af9a-67db57d83f33 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:07.017033 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0511e689-1de1-41d2-af9a-67db57d83f33 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1269 microversion: 2.1 time: 0.483780 Feb 21 04:14:07.021905 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 4/4] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:06 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1269 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:07.243784 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Flavor limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:14:07.244384 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Image limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:14:07.244747 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Flavor pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:14:07.245192 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Image pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:14:07.245613 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:14:07.272142 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:07.272873 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:07.273877 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:07.282597 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:07.355280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Getting quotas for project 72d3b51bfa7e4f3190c280abd14571ff. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:14:07.362853 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Getting quotas for user fe3e6f54f19b45ccb7522c5a2bc8a3c9 and project 72d3b51bfa7e4f3190c280abd14571ff. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:14:07.387361 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Going to run 1 instances... {{(pid=116570) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:14:07.390466 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:14:07.620798 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-35f85016-6f36-4ff5-8c56-237df0519ffa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.985341 Feb 21 04:14:07.624522 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 1/5] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:14:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 4995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:14:07.633533 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-600c11b1-d441-4ac0-906b-ad9327098d48 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:07.634689 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-600c11b1-d441-4ac0-906b-ad9327098d48 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:07.943329 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-600c11b1-d441-4ac0-906b-ad9327098d48 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:07.949997 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-600c11b1-d441-4ac0-906b-ad9327098d48 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1215 microversion: 2.1 time: 0.321521 Feb 21 04:14:07.952072 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 5/6] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:07 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1215 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:08.039205 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-743d93b6-df26-4f00-8d5b-e5248e4bee08 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:08.039840 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-743d93b6-df26-4f00-8d5b-e5248e4bee08 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:08.075022 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-743d93b6-df26-4f00-8d5b-e5248e4bee08 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:08.075973 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-743d93b6-df26-4f00-8d5b-e5248e4bee08 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:08.076995 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-743d93b6-df26-4f00-8d5b-e5248e4bee08 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:08.080778 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-743d93b6-df26-4f00-8d5b-e5248e4bee08 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:08.607202 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-743d93b6-df26-4f00-8d5b-e5248e4bee08 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:08.658898 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-743d93b6-df26-4f00-8d5b-e5248e4bee08 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1275 microversion: 2.1 time: 0.619367 Feb 21 04:14:08.662451 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 2/7] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:08 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1275 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:08.969017 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e18cefa5-5db1-4605-b276-3d8e49b0a251 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:08.970277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e18cefa5-5db1-4605-b276-3d8e49b0a251 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:09.285440 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e18cefa5-5db1-4605-b276-3d8e49b0a251 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:09.300162 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e18cefa5-5db1-4605-b276-3d8e49b0a251 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1215 microversion: 2.1 time: 0.336493 Feb 21 04:14:09.301192 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 6/8] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:08 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1215 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:09.679533 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-eb92884a-c56c-4d5b-aa6f-676b377e9d99 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:09.680330 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-eb92884a-c56c-4d5b-aa6f-676b377e9d99 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:09.693259 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eb92884a-c56c-4d5b-aa6f-676b377e9d99 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:09.696239 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eb92884a-c56c-4d5b-aa6f-676b377e9d99 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:09.698981 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eb92884a-c56c-4d5b-aa6f-676b377e9d99 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:09.701181 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eb92884a-c56c-4d5b-aa6f-676b377e9d99 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:09.758229 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1684134468", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:09.992977 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-eb92884a-c56c-4d5b-aa6f-676b377e9d99 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:09.993857 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.network.neutron [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] validate_networks() for [('2dbdf964-252c-4bd3-8302-8e42b37a68a2', None, None, None, None, None)] {{(pid=116570) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:14:10.001432 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-eb92884a-c56c-4d5b-aa6f-676b377e9d99 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1275 microversion: 2.1 time: 0.326104 Feb 21 04:14:10.001893 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 7/9] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:09 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1275 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:10.318815 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c95c4b15-b756-42d0-a4d6-a329e86090b5 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:10.320166 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c95c4b15-b756-42d0-a4d6-a329e86090b5 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:10.334478 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c95c4b15-b756-42d0-a4d6-a329e86090b5 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:10.335315 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c95c4b15-b756-42d0-a4d6-a329e86090b5 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:10.337418 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c95c4b15-b756-42d0-a4d6-a329e86090b5 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:10.338134 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c95c4b15-b756-42d0-a4d6-a329e86090b5 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:10.628473 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c95c4b15-b756-42d0-a4d6-a329e86090b5 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:10.636754 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c95c4b15-b756-42d0-a4d6-a329e86090b5 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1267 microversion: 2.1 time: 0.322296 Feb 21 04:14:10.651674 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 8/10] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:10 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1267 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:11.019251 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-899b5e0e-db0e-48dc-b137-ad1bcfc68252 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:11.019928 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-899b5e0e-db0e-48dc-b137-ad1bcfc68252 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:11.030901 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-899b5e0e-db0e-48dc-b137-ad1bcfc68252 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:11.034317 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-899b5e0e-db0e-48dc-b137-ad1bcfc68252 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:11.035251 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-899b5e0e-db0e-48dc-b137-ad1bcfc68252 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:11.035712 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-899b5e0e-db0e-48dc-b137-ad1bcfc68252 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:11.449126 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-899b5e0e-db0e-48dc-b137-ad1bcfc68252 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:11.458826 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-899b5e0e-db0e-48dc-b137-ad1bcfc68252 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1275 microversion: 2.1 time: 0.443717 Feb 21 04:14:11.462002 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 9/11] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:11 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1275 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:11.670161 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c6af07b6-0403-4709-a189-a70910b0195d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:11.670743 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c6af07b6-0403-4709-a189-a70910b0195d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:11.688727 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c6af07b6-0403-4709-a189-a70910b0195d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:11.693174 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c6af07b6-0403-4709-a189-a70910b0195d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:11.698315 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c6af07b6-0403-4709-a189-a70910b0195d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:11.701405 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c6af07b6-0403-4709-a189-a70910b0195d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:11.997086 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Flavor limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:14:11.997645 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Image limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:14:11.998044 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Flavor pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:14:11.998485 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Image pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:14:11.999228 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:14:12.014517 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:12.015169 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:12.016073 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:12.016519 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:12.021267 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c6af07b6-0403-4709-a189-a70910b0195d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:12.041736 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c6af07b6-0403-4709-a189-a70910b0195d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1273 microversion: 2.1 time: 0.377006 Feb 21 04:14:12.043028 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 10/12] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:11 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1273 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:12.064612 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Getting quotas for project aa414febea2c4d4eb40898c7b119111a. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:14:12.073928 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Getting quotas for user 24d6410449484671b517b6d671ed6576 and project aa414febea2c4d4eb40898c7b119111a. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:14:12.098437 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Going to run 1 instances... {{(pid=116570) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:14:12.103754 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:14:12.271300 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-aeff87cd-8afe-4164-bc56-2446f3d59422 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.171245 Feb 21 04:14:12.271963 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 3/13] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:14:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 3173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:14:12.285806 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-18f5cc31-34e5-497e-abc9-df73b1d6ac63 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:12.286398 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-18f5cc31-34e5-497e-abc9-df73b1d6ac63 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:12.476361 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e4f1b220-86e9-4acd-bcf5-2aaefcd8f183 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:12.477124 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e4f1b220-86e9-4acd-bcf5-2aaefcd8f183 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:12.497989 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e4f1b220-86e9-4acd-bcf5-2aaefcd8f183 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:12.498458 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e4f1b220-86e9-4acd-bcf5-2aaefcd8f183 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:12.499303 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e4f1b220-86e9-4acd-bcf5-2aaefcd8f183 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:12.506821 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e4f1b220-86e9-4acd-bcf5-2aaefcd8f183 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:13.392973 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-18f5cc31-34e5-497e-abc9-df73b1d6ac63 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:13.400408 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-18f5cc31-34e5-497e-abc9-df73b1d6ac63 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1222 microversion: 2.1 time: 1.118195 Feb 21 04:14:13.404962 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 11/14] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:12 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1222 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:13.411417 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7683d988-4ae6-4352-8897-4ab69b6d64c2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:13.423897 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7683d988-4ae6-4352-8897-4ab69b6d64c2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:13.442694 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7683d988-4ae6-4352-8897-4ab69b6d64c2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:13.449713 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7683d988-4ae6-4352-8897-4ab69b6d64c2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:13.453198 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7683d988-4ae6-4352-8897-4ab69b6d64c2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:13.454024 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7683d988-4ae6-4352-8897-4ab69b6d64c2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:13.768092 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7683d988-4ae6-4352-8897-4ab69b6d64c2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:13.783940 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7683d988-4ae6-4352-8897-4ab69b6d64c2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1273 microversion: 2.1 time: 0.375963 Feb 21 04:14:13.785430 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 12/15] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:13 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1273 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:13.849339 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1475311546", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:13.985209 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.network.neutron [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] validate_networks() for [('2dbdf964-252c-4bd3-8302-8e42b37a68a2', None, None, None, None, None)] {{(pid=116571) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:14:14.272369 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e4f1b220-86e9-4acd-bcf5-2aaefcd8f183 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:14.282711 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e4f1b220-86e9-4acd-bcf5-2aaefcd8f183 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 1.810565 Feb 21 04:14:14.283289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 4/16] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:12 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:14.831885 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f0b703ac-4c4e-419f-b07a-94a85212ff61 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:14.840920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f0b703ac-4c4e-419f-b07a-94a85212ff61 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:14.878246 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f0b703ac-4c4e-419f-b07a-94a85212ff61 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:14.878723 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f0b703ac-4c4e-419f-b07a-94a85212ff61 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:14.888108 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f0b703ac-4c4e-419f-b07a-94a85212ff61 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:14.894608 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f0b703ac-4c4e-419f-b07a-94a85212ff61 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:16.440965 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f0b703ac-4c4e-419f-b07a-94a85212ff61 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:16.455905 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f0b703ac-4c4e-419f-b07a-94a85212ff61 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 1.657007 Feb 21 04:14:16.459522 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 5/17] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:14 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:16.486926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-62ea87a9-d982-487b-be30-f963850c5052 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:16.487695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-62ea87a9-d982-487b-be30-f963850c5052 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:16.517695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-62ea87a9-d982-487b-be30-f963850c5052 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:16.520094 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-62ea87a9-d982-487b-be30-f963850c5052 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:16.522484 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-62ea87a9-d982-487b-be30-f963850c5052 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:16.526048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-62ea87a9-d982-487b-be30-f963850c5052 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:17.060291 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Flavor limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:14:17.060762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Image limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:14:17.061226 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Flavor pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:14:17.061682 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Image pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:14:17.062134 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:14:17.079110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:17.079503 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:17.080345 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:17.082981 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:17.120137 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Getting quotas for project aa414febea2c4d4eb40898c7b119111a. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:14:17.130778 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Getting quotas for user 24d6410449484671b517b6d671ed6576 and project aa414febea2c4d4eb40898c7b119111a. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:14:17.167529 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Going to run 1 instances... {{(pid=116571) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:14:17.170642 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:14:17.269600 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-62ea87a9-d982-487b-be30-f963850c5052 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:17.291649 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-62ea87a9-d982-487b-be30-f963850c5052 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.822397 Feb 21 04:14:17.292580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 6/18] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:16 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:17.476142 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-76ae1c7a-429e-4eb6-82fc-af17dccdcfdd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:17.477178 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-76ae1c7a-429e-4eb6-82fc-af17dccdcfdd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:17.490217 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-76ae1c7a-429e-4eb6-82fc-af17dccdcfdd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:17.490675 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-76ae1c7a-429e-4eb6-82fc-af17dccdcfdd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:17.491467 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-76ae1c7a-429e-4eb6-82fc-af17dccdcfdd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:17.491907 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-76ae1c7a-429e-4eb6-82fc-af17dccdcfdd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:17.504352 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-aa2b5c79-c500-4478-b024-3b1b2db4e967 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.657613 Feb 21 04:14:17.505464 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 13/19] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:14:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:14:17.530716 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0a2e7d6f-08b5-4f5f-bcf3-50e54c7c2f0d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:17.536299 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0a2e7d6f-08b5-4f5f-bcf3-50e54c7c2f0d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:17.963013 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0a2e7d6f-08b5-4f5f-bcf3-50e54c7c2f0d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:17.972082 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0a2e7d6f-08b5-4f5f-bcf3-50e54c7c2f0d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1222 microversion: 2.1 time: 0.459404 Feb 21 04:14:17.972082 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 14/20] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:17 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1222 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:18.155498 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-76ae1c7a-429e-4eb6-82fc-af17dccdcfdd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:18.172474 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-76ae1c7a-429e-4eb6-82fc-af17dccdcfdd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.696831 Feb 21 04:14:18.173732 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 7/21] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:17 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:18.314713 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9bf2ad0c-02c8-4004-acab-ff37a8cd5e35 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:18.315882 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9bf2ad0c-02c8-4004-acab-ff37a8cd5e35 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:18.328488 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9bf2ad0c-02c8-4004-acab-ff37a8cd5e35 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:18.328992 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9bf2ad0c-02c8-4004-acab-ff37a8cd5e35 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:18.329813 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9bf2ad0c-02c8-4004-acab-ff37a8cd5e35 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:18.337750 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9bf2ad0c-02c8-4004-acab-ff37a8cd5e35 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:18.533672 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a8d0b199-e832-45f6-b7a4-dc31b15781b2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Action: 'create', calling method: .version_select at 0x7feee195be50>, body: {"keypair": {"name": "tempest-keypair-2139569516"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:18.565102 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-a8d0b199-e832-45f6-b7a4-dc31b15781b2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Getting quotas for project 53f9f8c7b6284a97b2c5ac5aee7f3c79. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:14:18.569564 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-a8d0b199-e832-45f6-b7a4-dc31b15781b2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Getting quotas for user cd2b57fa426940dc8de7e72944ad4a80 and project 53f9f8c7b6284a97b2c5ac5aee7f3c79. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:14:18.978987 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-a8d0b199-e832-45f6-b7a4-dc31b15781b2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Getting quotas for project 53f9f8c7b6284a97b2c5ac5aee7f3c79. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:14:18.983518 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-a8d0b199-e832-45f6-b7a4-dc31b15781b2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Getting quotas for user cd2b57fa426940dc8de7e72944ad4a80 and project 53f9f8c7b6284a97b2c5ac5aee7f3c79. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:14:19.001243 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a8d0b199-e832-45f6-b7a4-dc31b15781b2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.007776 Feb 21 04:14:19.002143 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 15/22] 10.222.0.10 () {62 vars in 1198 bytes} [Mon Feb 21 04:14:17 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1030 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 21 04:14:19.008821 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b9ceb214-ce26-48ab-9639-08003e1fc2aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:19.009760 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b9ceb214-ce26-48ab-9639-08003e1fc2aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:19.018307 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b9ceb214-ce26-48ab-9639-08003e1fc2aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:19.019311 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b9ceb214-ce26-48ab-9639-08003e1fc2aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:19.020681 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b9ceb214-ce26-48ab-9639-08003e1fc2aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:19.021673 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b9ceb214-ce26-48ab-9639-08003e1fc2aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:19.114758 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9bf2ad0c-02c8-4004-acab-ff37a8cd5e35 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:19.132819 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9bf2ad0c-02c8-4004-acab-ff37a8cd5e35 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.822353 Feb 21 04:14:19.133045 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b9ceb214-ce26-48ab-9639-08003e1fc2aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:19.142582 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b9ceb214-ce26-48ab-9639-08003e1fc2aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1218 microversion: 2.1 time: 0.138327 Feb 21 04:14:19.150532 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 8/23] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:18 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:19.154801 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 16/24] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:19 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:19.190478 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3a4e0e18-38da-4b70-9249-3c3a6b855e6a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:19.191342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3a4e0e18-38da-4b70-9249-3c3a6b855e6a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:19.204624 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a4e0e18-38da-4b70-9249-3c3a6b855e6a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:19.206338 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a4e0e18-38da-4b70-9249-3c3a6b855e6a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:19.208988 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a4e0e18-38da-4b70-9249-3c3a6b855e6a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:19.209597 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a4e0e18-38da-4b70-9249-3c3a6b855e6a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:19.494310 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3a4e0e18-38da-4b70-9249-3c3a6b855e6a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:19.543586 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3a4e0e18-38da-4b70-9249-3c3a6b855e6a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.356970 Feb 21 04:14:19.552064 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 9/25] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:19 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:20.150851 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-994e7ee8-eb36-4f7a-b44e-adb876450a0b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:20.151581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-994e7ee8-eb36-4f7a-b44e-adb876450a0b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:20.160091 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-664cb76a-6ac8-4044-bb23-3bde8872d634 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:20.160880 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-664cb76a-6ac8-4044-bb23-3bde8872d634 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:20.168973 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-664cb76a-6ac8-4044-bb23-3bde8872d634 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:20.173478 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-994e7ee8-eb36-4f7a-b44e-adb876450a0b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:20.180446 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-994e7ee8-eb36-4f7a-b44e-adb876450a0b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:20.183588 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-664cb76a-6ac8-4044-bb23-3bde8872d634 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:20.184402 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-994e7ee8-eb36-4f7a-b44e-adb876450a0b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:20.187329 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-994e7ee8-eb36-4f7a-b44e-adb876450a0b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:20.188329 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-664cb76a-6ac8-4044-bb23-3bde8872d634 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:20.193116 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-664cb76a-6ac8-4044-bb23-3bde8872d634 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:20.682487 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-664cb76a-6ac8-4044-bb23-3bde8872d634 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:20.691699 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-664cb76a-6ac8-4044-bb23-3bde8872d634 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1292 microversion: 2.1 time: 0.535988 Feb 21 04:14:20.701894 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 10/26] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:20 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1292 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:20.724274 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b9120dfa-e991-4d6b-aff0-35d63d219ccb tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:20.728249 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b9120dfa-e991-4d6b-aff0-35d63d219ccb tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:20.752721 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b9120dfa-e991-4d6b-aff0-35d63d219ccb tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:20.760952 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b9120dfa-e991-4d6b-aff0-35d63d219ccb tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:20.767681 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b9120dfa-e991-4d6b-aff0-35d63d219ccb tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:20.770418 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b9120dfa-e991-4d6b-aff0-35d63d219ccb tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:22.082549 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b9120dfa-e991-4d6b-aff0-35d63d219ccb tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:22.091367 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b9120dfa-e991-4d6b-aff0-35d63d219ccb tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 1.384605 Feb 21 04:14:22.092399 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 11/27] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:20 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:22.105599 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-79696774-8c02-47c5-bbc2-9ffcfd6a05b1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:22.105778 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-994e7ee8-eb36-4f7a-b44e-adb876450a0b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:22.108228 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-79696774-8c02-47c5-bbc2-9ffcfd6a05b1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:22.118046 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-79696774-8c02-47c5-bbc2-9ffcfd6a05b1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:22.118723 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-79696774-8c02-47c5-bbc2-9ffcfd6a05b1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:22.119950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-79696774-8c02-47c5-bbc2-9ffcfd6a05b1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:22.120745 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-79696774-8c02-47c5-bbc2-9ffcfd6a05b1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:22.141616 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-994e7ee8-eb36-4f7a-b44e-adb876450a0b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 1.994724 Feb 21 04:14:22.155202 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 17/28] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:20 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:22.267548 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-b58ad5b3-9ab3-45e2-bfed-0bfd6fb5d1cd req-bc49152e-5b72-43b9-abf8-d5c935111401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efbdc0a4-bc84-45b4-ab5f-5a38689d0b41", "tag": "81c2bfeb-6e2e-4b6e-a06d-1af7c280bad5"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:22.281018 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:14:22.281018 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:14:22.304707 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-79696774-8c02-47c5-bbc2-9ffcfd6a05b1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:22.315839 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-79696774-8c02-47c5-bbc2-9ffcfd6a05b1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1280 microversion: 2.1 time: 0.220960 Feb 21 04:14:22.326188 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 12/29] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:22 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1280 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:22.327324 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-b58ad5b3-9ab3-45e2-bfed-0bfd6fb5d1cd req-bc49152e-5b72-43b9-abf8-d5c935111401 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:22.329625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-b58ad5b3-9ab3-45e2-bfed-0bfd6fb5d1cd req-bc49152e-5b72-43b9-abf8-d5c935111401 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:22.392050 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-b58ad5b3-9ab3-45e2-bfed-0bfd6fb5d1cd req-bc49152e-5b72-43b9-abf8-d5c935111401 service nova] Creating event network-changed:81c2bfeb-6e2e-4b6e-a06d-1af7c280bad5 for instance efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 on hv-cinder-77398 Feb 21 04:14:22.393553 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-b58ad5b3-9ab3-45e2-bfed-0bfd6fb5d1cd req-bc49152e-5b72-43b9-abf8-d5c935111401 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 21 04:14:22.409855 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-53966171-dbcb-4c58-851c-783aec7a4e82 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:22.410544 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-53966171-dbcb-4c58-851c-783aec7a4e82 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:22.411676 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-53966171-dbcb-4c58-851c-783aec7a4e82 None None] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:22.412323 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-53966171-dbcb-4c58-851c-783aec7a4e82 None None] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:22.427709 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.compute.rpcapi [None req-53966171-dbcb-4c58-851c-783aec7a4e82 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 21 04:14:22.441910 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-53966171-dbcb-4c58-851c-783aec7a4e82 None None] Releasing lock "compute-rpcapi-router" {{(pid=116571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 21 04:14:22.469810 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-53966171-dbcb-4c58-851c-783aec7a4e82 None None] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319058 Feb 21 04:14:22.470779 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 18/30] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:14:23.116850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-00751569-2d27-4e41-b3d7-0342f33ed04b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:23.118427 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-00751569-2d27-4e41-b3d7-0342f33ed04b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:23.132020 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-00751569-2d27-4e41-b3d7-0342f33ed04b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:23.132664 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-00751569-2d27-4e41-b3d7-0342f33ed04b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:23.134204 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-00751569-2d27-4e41-b3d7-0342f33ed04b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:23.134826 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-00751569-2d27-4e41-b3d7-0342f33ed04b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:23.169554 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-664a3c44-5959-46d0-b92c-f2da84407b89 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:23.172588 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-664a3c44-5959-46d0-b92c-f2da84407b89 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:23.190639 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-664a3c44-5959-46d0-b92c-f2da84407b89 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:23.191463 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-664a3c44-5959-46d0-b92c-f2da84407b89 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:23.193380 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-664a3c44-5959-46d0-b92c-f2da84407b89 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:23.195264 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-664a3c44-5959-46d0-b92c-f2da84407b89 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:23.724767 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-00751569-2d27-4e41-b3d7-0342f33ed04b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:23.732114 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-00751569-2d27-4e41-b3d7-0342f33ed04b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.626202 Feb 21 04:14:23.745019 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 13/31] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:23 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:23.751767 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-cb40069d-0d14-4a86-a03a-243f9654d1c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:23.752776 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-cb40069d-0d14-4a86-a03a-243f9654d1c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:23.763461 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cb40069d-0d14-4a86-a03a-243f9654d1c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:23.768995 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cb40069d-0d14-4a86-a03a-243f9654d1c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:23.769896 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cb40069d-0d14-4a86-a03a-243f9654d1c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:23.770436 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cb40069d-0d14-4a86-a03a-243f9654d1c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:23.887960 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-664a3c44-5959-46d0-b92c-f2da84407b89 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:23.896232 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-664a3c44-5959-46d0-b92c-f2da84407b89 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.737323 Feb 21 04:14:23.900045 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 19/32] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:23 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:24.085089 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-cb40069d-0d14-4a86-a03a-243f9654d1c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:24.093405 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-cb40069d-0d14-4a86-a03a-243f9654d1c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.346931 Feb 21 04:14:24.103410 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 14/33] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:23 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:24.491005 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-4a1e7ffb-b9fb-4095-a51c-46213203a9ba req-89dafa1d-568a-4126-a37e-6dcb1f431944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58885ac-0561-4c6d-bdb4-97e629c9acaa", "tag": "fc039608-7f10-4b0d-b3ce-2ecd0aa5274d"}, {"name": "network-changed", "server_uuid": "26c2ec47-cdd2-4f7a-a523-8afdb8f2656d", "tag": "9dcd026b-bef5-4076-bab8-0b8c1cff42f3"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:24.495350 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:14:24.495350 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:14:24.505692 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-4a1e7ffb-b9fb-4095-a51c-46213203a9ba req-89dafa1d-568a-4126-a37e-6dcb1f431944 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:24.506347 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-4a1e7ffb-b9fb-4095-a51c-46213203a9ba req-89dafa1d-568a-4126-a37e-6dcb1f431944 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:24.520946 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-4a1e7ffb-b9fb-4095-a51c-46213203a9ba req-89dafa1d-568a-4126-a37e-6dcb1f431944 service nova] Creating event network-changed:fc039608-7f10-4b0d-b3ce-2ecd0aa5274d for instance d58885ac-0561-4c6d-bdb4-97e629c9acaa on hv-cinder-77398 Feb 21 04:14:24.521838 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-4a1e7ffb-b9fb-4095-a51c-46213203a9ba req-89dafa1d-568a-4126-a37e-6dcb1f431944 service nova] Creating event network-changed:9dcd026b-bef5-4076-bab8-0b8c1cff42f3 for instance 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d on hv-cinder-77398 Feb 21 04:14:24.528519 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-4a1e7ffb-b9fb-4095-a51c-46213203a9ba req-89dafa1d-568a-4126-a37e-6dcb1f431944 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042887 Feb 21 04:14:24.534714 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 20/34] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:14:24.756113 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f77e2159-a0c3-4b7f-8f3e-320312f6f44c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:24.756709 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f77e2159-a0c3-4b7f-8f3e-320312f6f44c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:24.774440 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f77e2159-a0c3-4b7f-8f3e-320312f6f44c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:24.775066 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f77e2159-a0c3-4b7f-8f3e-320312f6f44c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:24.775950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f77e2159-a0c3-4b7f-8f3e-320312f6f44c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:24.776385 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f77e2159-a0c3-4b7f-8f3e-320312f6f44c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:24.879578 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1572048328", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81e10afa-1f4c-4986-8e6d-20263abcd54c"}], "security_groups": [{"name": "tempest-securitygroup--528023676"}], "key_name": "tempest-keypair-2139569516", "user_data": "}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:24.934645 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f77e2159-a0c3-4b7f-8f3e-320312f6f44c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:24.950870 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f77e2159-a0c3-4b7f-8f3e-320312f6f44c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.199287 Feb 21 04:14:24.951654 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 15/35] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:24 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:24.958415 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2f415e35-8efd-4da9-ada3-0e65887fdd3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:24.959262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2f415e35-8efd-4da9-ada3-0e65887fdd3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:24.965707 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2f415e35-8efd-4da9-ada3-0e65887fdd3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:24.966246 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2f415e35-8efd-4da9-ada3-0e65887fdd3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:24.967105 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2f415e35-8efd-4da9-ada3-0e65887fdd3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:24.967706 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2f415e35-8efd-4da9-ada3-0e65887fdd3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:25.022371 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.network.neutron [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] validate_networks() for [('81e10afa-1f4c-4986-8e6d-20263abcd54c', None, None, None, None, None)] {{(pid=116571) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:14:25.200951 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2f415e35-8efd-4da9-ada3-0e65887fdd3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:25.208185 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2f415e35-8efd-4da9-ada3-0e65887fdd3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.255513 Feb 21 04:14:25.208871 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 16/36] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:24 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:25.213203 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2c1e212e-43b6-4951-b9fe-702559cbd01c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:25.213889 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2c1e212e-43b6-4951-b9fe-702559cbd01c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:25.219489 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2c1e212e-43b6-4951-b9fe-702559cbd01c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:25.219937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2c1e212e-43b6-4951-b9fe-702559cbd01c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:25.220737 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2c1e212e-43b6-4951-b9fe-702559cbd01c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:25.221182 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2c1e212e-43b6-4951-b9fe-702559cbd01c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:25.470977 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2c1e212e-43b6-4951-b9fe-702559cbd01c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:25.478149 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2c1e212e-43b6-4951-b9fe-702559cbd01c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.268234 Feb 21 04:14:25.478801 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 17/37] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:25 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:25.506043 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Flavor limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:14:25.506470 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Image limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:14:25.506927 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Flavor pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:14:25.507365 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Image pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:14:25.507776 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:14:25.516178 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:25.516681 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:25.517483 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:25.517915 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:25.534179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Getting quotas for project 53f9f8c7b6284a97b2c5ac5aee7f3c79. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:14:25.538010 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Getting quotas for user cd2b57fa426940dc8de7e72944ad4a80 and project 53f9f8c7b6284a97b2c5ac5aee7f3c79. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:14:25.548937 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Going to run 1 instances... {{(pid=116571) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:14:25.551317 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:14:25.597157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f63d4b04-6e81-44e3-b2ea-ddb940f5a939 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.723053 Feb 21 04:14:25.597739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 21/38] 10.222.0.10 () {62 vars in 1187 bytes} [Mon Feb 21 04:14:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 21 04:14:25.607393 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1e82c608-f1f1-4362-a1fd-0ad53c79c827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:25.608086 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1e82c608-f1f1-4362-a1fd-0ad53c79c827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:25.662992 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1e82c608-f1f1-4362-a1fd-0ad53c79c827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:25.674568 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1e82c608-f1f1-4362-a1fd-0ad53c79c827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:25.676108 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1e82c608-f1f1-4362-a1fd-0ad53c79c827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:25.677273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1e82c608-f1f1-4362-a1fd-0ad53c79c827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1282 microversion: 2.20 time: 0.073531 Feb 21 04:14:25.677853 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 18/39] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:25 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:25.970197 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-bd17e847-2e7f-4351-825d-40e70f29fde6 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:25.970816 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-bd17e847-2e7f-4351-825d-40e70f29fde6 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:25.977406 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bd17e847-2e7f-4351-825d-40e70f29fde6 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:25.977857 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bd17e847-2e7f-4351-825d-40e70f29fde6 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:25.978691 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bd17e847-2e7f-4351-825d-40e70f29fde6 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:25.979130 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bd17e847-2e7f-4351-825d-40e70f29fde6 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:26.113484 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-bd17e847-2e7f-4351-825d-40e70f29fde6 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:26.120617 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-bd17e847-2e7f-4351-825d-40e70f29fde6 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.155104 Feb 21 04:14:26.121274 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 22/40] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:25 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:26.223985 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ee287bec-726e-40e1-ae2d-88ed934ab621 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:26.224551 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ee287bec-726e-40e1-ae2d-88ed934ab621 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:26.230524 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ee287bec-726e-40e1-ae2d-88ed934ab621 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:26.230970 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ee287bec-726e-40e1-ae2d-88ed934ab621 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:26.231740 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ee287bec-726e-40e1-ae2d-88ed934ab621 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:26.232174 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ee287bec-726e-40e1-ae2d-88ed934ab621 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:26.363074 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ee287bec-726e-40e1-ae2d-88ed934ab621 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:26.370181 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ee287bec-726e-40e1-ae2d-88ed934ab621 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.149917 Feb 21 04:14:26.370742 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 19/41] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:26 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:26.494988 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-bb99a5d7-c818-494d-b973-bb5199cd5026 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:26.495526 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-bb99a5d7-c818-494d-b973-bb5199cd5026 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:26.501901 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bb99a5d7-c818-494d-b973-bb5199cd5026 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:26.502349 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bb99a5d7-c818-494d-b973-bb5199cd5026 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:26.503120 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bb99a5d7-c818-494d-b973-bb5199cd5026 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:26.503561 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bb99a5d7-c818-494d-b973-bb5199cd5026 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:26.633019 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-bb99a5d7-c818-494d-b973-bb5199cd5026 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:26.640339 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-bb99a5d7-c818-494d-b973-bb5199cd5026 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.148952 Feb 21 04:14:26.640950 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 23/42] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:26 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:26.695088 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-92759157-def2-49d8-b5fb-28b9b7026bfe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:26.695738 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-92759157-def2-49d8-b5fb-28b9b7026bfe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:26.702289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-92759157-def2-49d8-b5fb-28b9b7026bfe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:26.702717 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-92759157-def2-49d8-b5fb-28b9b7026bfe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:26.703508 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-92759157-def2-49d8-b5fb-28b9b7026bfe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:26.704012 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-92759157-def2-49d8-b5fb-28b9b7026bfe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:26.765190 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-92759157-def2-49d8-b5fb-28b9b7026bfe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:26.773896 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-92759157-def2-49d8-b5fb-28b9b7026bfe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:26.775408 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-92759157-def2-49d8-b5fb-28b9b7026bfe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:26.776535 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-92759157-def2-49d8-b5fb-28b9b7026bfe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1286 microversion: 2.20 time: 0.085210 Feb 21 04:14:26.777321 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 20/43] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:26 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:27.138203 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c69ce54f-daa9-4c21-a394-4c4ad1191ea3 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:27.139150 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c69ce54f-daa9-4c21-a394-4c4ad1191ea3 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:27.145425 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c69ce54f-daa9-4c21-a394-4c4ad1191ea3 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:27.146011 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c69ce54f-daa9-4c21-a394-4c4ad1191ea3 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:27.146801 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c69ce54f-daa9-4c21-a394-4c4ad1191ea3 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:27.147241 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c69ce54f-daa9-4c21-a394-4c4ad1191ea3 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:27.295501 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c69ce54f-daa9-4c21-a394-4c4ad1191ea3 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:27.303736 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c69ce54f-daa9-4c21-a394-4c4ad1191ea3 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.169144 Feb 21 04:14:27.304329 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 24/44] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:27 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:27.388546 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-31b2c421-12f5-4764-92ab-f94ba97e8656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:27.389170 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-31b2c421-12f5-4764-92ab-f94ba97e8656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:27.395465 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-31b2c421-12f5-4764-92ab-f94ba97e8656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:27.395916 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-31b2c421-12f5-4764-92ab-f94ba97e8656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:27.396720 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-31b2c421-12f5-4764-92ab-f94ba97e8656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:27.397161 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-31b2c421-12f5-4764-92ab-f94ba97e8656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:27.531811 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-31b2c421-12f5-4764-92ab-f94ba97e8656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:27.538958 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-31b2c421-12f5-4764-92ab-f94ba97e8656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.153995 Feb 21 04:14:27.539519 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 21/45] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:27 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:27.657049 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-94507d71-70a5-4b5e-ba8b-507554cccc83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:27.657666 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-94507d71-70a5-4b5e-ba8b-507554cccc83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:27.663448 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-94507d71-70a5-4b5e-ba8b-507554cccc83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:27.663907 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-94507d71-70a5-4b5e-ba8b-507554cccc83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:27.664715 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-94507d71-70a5-4b5e-ba8b-507554cccc83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:27.665161 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-94507d71-70a5-4b5e-ba8b-507554cccc83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:27.794040 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-94507d71-70a5-4b5e-ba8b-507554cccc83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:27.794869 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8cdf4e21-665a-4532-a39e-ba9f9a1380f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:27.795663 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8cdf4e21-665a-4532-a39e-ba9f9a1380f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:27.801854 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-94507d71-70a5-4b5e-ba8b-507554cccc83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.148663 Feb 21 04:14:27.801961 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8cdf4e21-665a-4532-a39e-ba9f9a1380f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:27.802627 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 25/46] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:27 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:27.802734 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8cdf4e21-665a-4532-a39e-ba9f9a1380f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:27.803605 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8cdf4e21-665a-4532-a39e-ba9f9a1380f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:27.804156 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8cdf4e21-665a-4532-a39e-ba9f9a1380f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:27.865227 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8cdf4e21-665a-4532-a39e-ba9f9a1380f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:27.872850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8cdf4e21-665a-4532-a39e-ba9f9a1380f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:27.874991 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8cdf4e21-665a-4532-a39e-ba9f9a1380f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:27.876093 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8cdf4e21-665a-4532-a39e-ba9f9a1380f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1286 microversion: 2.20 time: 0.085051 Feb 21 04:14:27.876670 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 22/47] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:27 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:14:28.320318 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ee0611db-57df-4ac9-adaf-6638cd9c6f04 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:28.320968 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ee0611db-57df-4ac9-adaf-6638cd9c6f04 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:28.326914 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ee0611db-57df-4ac9-adaf-6638cd9c6f04 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:28.327373 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ee0611db-57df-4ac9-adaf-6638cd9c6f04 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:28.328214 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ee0611db-57df-4ac9-adaf-6638cd9c6f04 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:28.328674 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ee0611db-57df-4ac9-adaf-6638cd9c6f04 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:28.555128 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-21d8cf38-6f20-4ebd-95da-66af645bc13c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:28.556428 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-21d8cf38-6f20-4ebd-95da-66af645bc13c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:28.563161 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-21d8cf38-6f20-4ebd-95da-66af645bc13c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:28.564042 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-21d8cf38-6f20-4ebd-95da-66af645bc13c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:28.565686 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-21d8cf38-6f20-4ebd-95da-66af645bc13c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:28.566277 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-21d8cf38-6f20-4ebd-95da-66af645bc13c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:28.671723 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ee0611db-57df-4ac9-adaf-6638cd9c6f04 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:28.683773 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ee0611db-57df-4ac9-adaf-6638cd9c6f04 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.364747 Feb 21 04:14:28.684888 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 26/48] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:28 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:28.819638 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ff76c4c1-3eee-483a-a2ca-9707f5258e06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:28.820361 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ff76c4c1-3eee-483a-a2ca-9707f5258e06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:28.826440 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ff76c4c1-3eee-483a-a2ca-9707f5258e06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:28.827005 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ff76c4c1-3eee-483a-a2ca-9707f5258e06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:28.829309 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ff76c4c1-3eee-483a-a2ca-9707f5258e06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:28.829830 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ff76c4c1-3eee-483a-a2ca-9707f5258e06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:29.020305 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-21d8cf38-6f20-4ebd-95da-66af645bc13c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:29.030631 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-21d8cf38-6f20-4ebd-95da-66af645bc13c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.479072 Feb 21 04:14:29.032037 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 23/49] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:28 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:29.037493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-67e3e9ed-1521-40e3-b329-938c874ff80a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:29.038343 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-67e3e9ed-1521-40e3-b329-938c874ff80a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:29.050478 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-67e3e9ed-1521-40e3-b329-938c874ff80a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:29.051245 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-67e3e9ed-1521-40e3-b329-938c874ff80a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:29.052392 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-67e3e9ed-1521-40e3-b329-938c874ff80a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:29.053055 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-67e3e9ed-1521-40e3-b329-938c874ff80a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:29.168469 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-67e3e9ed-1521-40e3-b329-938c874ff80a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:29.187678 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-67e3e9ed-1521-40e3-b329-938c874ff80a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:29.189367 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-67e3e9ed-1521-40e3-b329-938c874ff80a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:29.191885 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-67e3e9ed-1521-40e3-b329-938c874ff80a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1334 microversion: 2.20 time: 0.157968 Feb 21 04:14:29.192424 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 24/50] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:29 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1334 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:29.223483 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ff76c4c1-3eee-483a-a2ca-9707f5258e06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:29.231473 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ff76c4c1-3eee-483a-a2ca-9707f5258e06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.416249 Feb 21 04:14:29.244804 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 27/51] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:28 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:29.704125 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8aeff52c-d9e9-4fa8-9fb9-51bcec6f2bba tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:29.705518 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8aeff52c-d9e9-4fa8-9fb9-51bcec6f2bba tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:29.715932 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8aeff52c-d9e9-4fa8-9fb9-51bcec6f2bba tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:29.716928 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8aeff52c-d9e9-4fa8-9fb9-51bcec6f2bba tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:29.718792 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8aeff52c-d9e9-4fa8-9fb9-51bcec6f2bba tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:29.719673 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8aeff52c-d9e9-4fa8-9fb9-51bcec6f2bba tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:29.944194 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-b2e4fa4c-b995-4294-b6a1-0730ab63035d req-6c3b319b-cb0e-472c-9d4d-ca7a88c13ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08569093-3abd-43da-8dc2-605b9a289ccf", "tag": "18fcec87-d164-4874-b7ec-0a2d9c6fb0df"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:29.954628 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:14:29.954628 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:14:29.970975 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-b2e4fa4c-b995-4294-b6a1-0730ab63035d req-6c3b319b-cb0e-472c-9d4d-ca7a88c13ef6 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:29.971439 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-b2e4fa4c-b995-4294-b6a1-0730ab63035d req-6c3b319b-cb0e-472c-9d4d-ca7a88c13ef6 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:29.997205 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-b2e4fa4c-b995-4294-b6a1-0730ab63035d req-6c3b319b-cb0e-472c-9d4d-ca7a88c13ef6 service nova] Creating event network-changed:18fcec87-d164-4874-b7ec-0a2d9c6fb0df for instance 08569093-3abd-43da-8dc2-605b9a289ccf on hv-cinder-77398 Feb 21 04:14:30.007194 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-b2e4fa4c-b995-4294-b6a1-0730ab63035d req-6c3b319b-cb0e-472c-9d4d-ca7a88c13ef6 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133548 Feb 21 04:14:30.011351 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 28/52] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:14:30.049189 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ad9fda69-f65a-4dd8-a5d9-14e8fb0e74c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:30.050194 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ad9fda69-f65a-4dd8-a5d9-14e8fb0e74c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:30.059819 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ad9fda69-f65a-4dd8-a5d9-14e8fb0e74c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:30.060374 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ad9fda69-f65a-4dd8-a5d9-14e8fb0e74c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:30.061356 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ad9fda69-f65a-4dd8-a5d9-14e8fb0e74c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:30.062082 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ad9fda69-f65a-4dd8-a5d9-14e8fb0e74c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:30.149079 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8aeff52c-d9e9-4fa8-9fb9-51bcec6f2bba tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:30.207938 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8aeff52c-d9e9-4fa8-9fb9-51bcec6f2bba tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.509683 Feb 21 04:14:30.220317 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 25/53] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:29 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:30.227117 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-18e1e22c-f892-4b7e-8361-631ed6d1b5e2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:30.228272 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-18e1e22c-f892-4b7e-8361-631ed6d1b5e2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:30.237787 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18e1e22c-f892-4b7e-8361-631ed6d1b5e2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:30.239538 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18e1e22c-f892-4b7e-8361-631ed6d1b5e2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:30.241740 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18e1e22c-f892-4b7e-8361-631ed6d1b5e2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:30.242415 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18e1e22c-f892-4b7e-8361-631ed6d1b5e2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:30.389031 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-18e1e22c-f892-4b7e-8361-631ed6d1b5e2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:30.402265 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-18e1e22c-f892-4b7e-8361-631ed6d1b5e2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:30.405142 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-18e1e22c-f892-4b7e-8361-631ed6d1b5e2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:30.407091 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-18e1e22c-f892-4b7e-8361-631ed6d1b5e2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1340 microversion: 2.20 time: 0.185074 Feb 21 04:14:30.407867 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 26/54] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:30 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1340 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:30.413002 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8fad9f27-90e4-41a0-978a-5c2b522f5aa3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:30.414466 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8fad9f27-90e4-41a0-978a-5c2b522f5aa3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:30.420942 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8fad9f27-90e4-41a0-978a-5c2b522f5aa3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:30.421651 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8fad9f27-90e4-41a0-978a-5c2b522f5aa3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:30.422754 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8fad9f27-90e4-41a0-978a-5c2b522f5aa3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:30.423258 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8fad9f27-90e4-41a0-978a-5c2b522f5aa3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:30.446066 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ad9fda69-f65a-4dd8-a5d9-14e8fb0e74c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:30.457600 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ad9fda69-f65a-4dd8-a5d9-14e8fb0e74c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.413713 Feb 21 04:14:30.461835 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 29/55] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:30 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:30.728232 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8fad9f27-90e4-41a0-978a-5c2b522f5aa3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:30.735743 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8fad9f27-90e4-41a0-978a-5c2b522f5aa3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.326648 Feb 21 04:14:30.750333 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 27/56] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:30 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:31.226185 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c44765b1-2106-497c-a860-7032176a7a34 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:31.226849 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c44765b1-2106-497c-a860-7032176a7a34 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:31.232546 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c44765b1-2106-497c-a860-7032176a7a34 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:31.233034 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c44765b1-2106-497c-a860-7032176a7a34 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:31.234333 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c44765b1-2106-497c-a860-7032176a7a34 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:31.234833 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c44765b1-2106-497c-a860-7032176a7a34 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:31.379025 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c44765b1-2106-497c-a860-7032176a7a34 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:31.389161 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c44765b1-2106-497c-a860-7032176a7a34 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.166062 Feb 21 04:14:31.389814 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 30/57] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:31 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:31.426107 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-07f9defe-a0df-4d61-8414-c604ca160e6e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:31.426817 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-07f9defe-a0df-4d61-8414-c604ca160e6e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:31.432933 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-07f9defe-a0df-4d61-8414-c604ca160e6e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:31.433470 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-07f9defe-a0df-4d61-8414-c604ca160e6e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:31.434264 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-07f9defe-a0df-4d61-8414-c604ca160e6e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:31.434720 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-07f9defe-a0df-4d61-8414-c604ca160e6e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:31.477825 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-096f5c36-e044-4746-b124-8a2984624aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:31.478356 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-096f5c36-e044-4746-b124-8a2984624aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:31.485326 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-096f5c36-e044-4746-b124-8a2984624aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:31.486009 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-096f5c36-e044-4746-b124-8a2984624aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:31.486800 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-096f5c36-e044-4746-b124-8a2984624aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:31.487241 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-096f5c36-e044-4746-b124-8a2984624aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:31.601895 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-07f9defe-a0df-4d61-8414-c604ca160e6e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:31.610331 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-07f9defe-a0df-4d61-8414-c604ca160e6e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:31.611847 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-07f9defe-a0df-4d61-8414-c604ca160e6e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:31.613066 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-07f9defe-a0df-4d61-8414-c604ca160e6e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.190621 Feb 21 04:14:31.613647 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 28/58] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:31 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:31.658392 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-096f5c36-e044-4746-b124-8a2984624aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:31.665662 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-096f5c36-e044-4746-b124-8a2984624aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.191843 Feb 21 04:14:31.666317 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 31/59] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:31 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:31.759070 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0181a2f1-c91c-43f8-b240-e2ca4265ebef tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:31.759609 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0181a2f1-c91c-43f8-b240-e2ca4265ebef tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:31.766220 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0181a2f1-c91c-43f8-b240-e2ca4265ebef tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:31.766677 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0181a2f1-c91c-43f8-b240-e2ca4265ebef tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:31.767452 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0181a2f1-c91c-43f8-b240-e2ca4265ebef tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:31.767888 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0181a2f1-c91c-43f8-b240-e2ca4265ebef tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:31.899429 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0181a2f1-c91c-43f8-b240-e2ca4265ebef tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:31.907402 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0181a2f1-c91c-43f8-b240-e2ca4265ebef tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.151966 Feb 21 04:14:31.907971 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 29/60] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:31 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:32.405854 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-79728a45-819b-4977-bc46-dc52d973c330 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:32.406469 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-79728a45-819b-4977-bc46-dc52d973c330 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:32.412269 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79728a45-819b-4977-bc46-dc52d973c330 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:32.412752 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79728a45-819b-4977-bc46-dc52d973c330 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:32.413564 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79728a45-819b-4977-bc46-dc52d973c330 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:32.413998 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79728a45-819b-4977-bc46-dc52d973c330 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:32.544342 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-79728a45-819b-4977-bc46-dc52d973c330 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:32.552054 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-79728a45-819b-4977-bc46-dc52d973c330 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.150190 Feb 21 04:14:32.552616 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 32/61] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:32 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:32.630895 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2f695577-5d9e-4851-82fb-60abd6da003e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:32.631524 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2f695577-5d9e-4851-82fb-60abd6da003e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:32.637352 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2f695577-5d9e-4851-82fb-60abd6da003e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:32.637800 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2f695577-5d9e-4851-82fb-60abd6da003e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:32.638573 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2f695577-5d9e-4851-82fb-60abd6da003e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:32.639006 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2f695577-5d9e-4851-82fb-60abd6da003e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:32.682269 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ead3dbab-909a-4800-ae2f-16f7f616f086 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:32.682794 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ead3dbab-909a-4800-ae2f-16f7f616f086 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:32.689117 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ead3dbab-909a-4800-ae2f-16f7f616f086 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:32.689563 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ead3dbab-909a-4800-ae2f-16f7f616f086 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:32.690332 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ead3dbab-909a-4800-ae2f-16f7f616f086 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:32.690763 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ead3dbab-909a-4800-ae2f-16f7f616f086 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:32.800393 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2f695577-5d9e-4851-82fb-60abd6da003e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:32.808188 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2f695577-5d9e-4851-82fb-60abd6da003e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:32.809729 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2f695577-5d9e-4851-82fb-60abd6da003e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:32.810823 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2f695577-5d9e-4851-82fb-60abd6da003e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.183614 Feb 21 04:14:32.811701 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 30/62] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:32 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:32.854969 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ead3dbab-909a-4800-ae2f-16f7f616f086 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:32.862787 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ead3dbab-909a-4800-ae2f-16f7f616f086 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.184219 Feb 21 04:14:32.863365 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 33/63] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:32 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:32.924124 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-89b3a0cd-7fd0-42c6-8c7b-6cf56f631035 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:32.924759 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-89b3a0cd-7fd0-42c6-8c7b-6cf56f631035 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:32.930469 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-89b3a0cd-7fd0-42c6-8c7b-6cf56f631035 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:32.930913 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-89b3a0cd-7fd0-42c6-8c7b-6cf56f631035 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:32.931680 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-89b3a0cd-7fd0-42c6-8c7b-6cf56f631035 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:32.932115 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-89b3a0cd-7fd0-42c6-8c7b-6cf56f631035 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:33.063091 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-89b3a0cd-7fd0-42c6-8c7b-6cf56f631035 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:33.070150 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-89b3a0cd-7fd0-42c6-8c7b-6cf56f631035 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.150111 Feb 21 04:14:33.070717 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 31/64] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:32 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:33.568199 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4a0869f4-f325-48c5-885e-da0ce35101f9 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:33.568782 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4a0869f4-f325-48c5-885e-da0ce35101f9 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:33.574585 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4a0869f4-f325-48c5-885e-da0ce35101f9 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:33.575033 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4a0869f4-f325-48c5-885e-da0ce35101f9 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:33.575803 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4a0869f4-f325-48c5-885e-da0ce35101f9 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:33.576237 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4a0869f4-f325-48c5-885e-da0ce35101f9 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:33.706780 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4a0869f4-f325-48c5-885e-da0ce35101f9 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:33.713883 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4a0869f4-f325-48c5-885e-da0ce35101f9 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.149328 Feb 21 04:14:33.714445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 34/65] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:33 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:33.828997 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-864a06d5-1d70-4c9b-8851-517df18b615d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:33.829547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-864a06d5-1d70-4c9b-8851-517df18b615d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:33.835363 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-864a06d5-1d70-4c9b-8851-517df18b615d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:33.835809 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-864a06d5-1d70-4c9b-8851-517df18b615d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:33.836573 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-864a06d5-1d70-4c9b-8851-517df18b615d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:33.837031 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-864a06d5-1d70-4c9b-8851-517df18b615d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:33.879461 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d991d888-f613-4cf2-8f21-6eaab210820b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:33.880088 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d991d888-f613-4cf2-8f21-6eaab210820b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:33.885901 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d991d888-f613-4cf2-8f21-6eaab210820b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:33.886330 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d991d888-f613-4cf2-8f21-6eaab210820b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:33.887105 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d991d888-f613-4cf2-8f21-6eaab210820b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:33.887539 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d991d888-f613-4cf2-8f21-6eaab210820b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:33.992128 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-864a06d5-1d70-4c9b-8851-517df18b615d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:34.000506 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-864a06d5-1d70-4c9b-8851-517df18b615d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:34.002047 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-864a06d5-1d70-4c9b-8851-517df18b615d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:34.003146 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-864a06d5-1d70-4c9b-8851-517df18b615d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.178494 Feb 21 04:14:34.003711 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 32/66] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:33 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:34.050293 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d991d888-f613-4cf2-8f21-6eaab210820b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:34.057577 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d991d888-f613-4cf2-8f21-6eaab210820b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.181669 Feb 21 04:14:34.058148 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 35/67] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:33 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:34.087213 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-77e568fd-255b-40e5-a19d-b314d06e84df tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:34.087762 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-77e568fd-255b-40e5-a19d-b314d06e84df tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:34.093858 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-77e568fd-255b-40e5-a19d-b314d06e84df tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:34.094154 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-77e568fd-255b-40e5-a19d-b314d06e84df tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:34.094933 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-77e568fd-255b-40e5-a19d-b314d06e84df tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:34.095365 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-77e568fd-255b-40e5-a19d-b314d06e84df tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:34.228237 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-77e568fd-255b-40e5-a19d-b314d06e84df tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:34.236142 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-77e568fd-255b-40e5-a19d-b314d06e84df tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.152568 Feb 21 04:14:34.236733 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 33/68] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:34 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:34.730480 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0288e0d9-0f57-4250-ab17-d8f170c82981 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:34.731093 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0288e0d9-0f57-4250-ab17-d8f170c82981 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:34.737076 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0288e0d9-0f57-4250-ab17-d8f170c82981 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:34.737531 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0288e0d9-0f57-4250-ab17-d8f170c82981 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:34.742571 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0288e0d9-0f57-4250-ab17-d8f170c82981 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:34.742571 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0288e0d9-0f57-4250-ab17-d8f170c82981 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:34.874915 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0288e0d9-0f57-4250-ab17-d8f170c82981 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:34.882450 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0288e0d9-0f57-4250-ab17-d8f170c82981 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.155539 Feb 21 04:14:34.882950 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 36/69] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:34 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:35.021368 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-36a6cb4e-0538-424c-8497-181de43c326f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:35.021982 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-36a6cb4e-0538-424c-8497-181de43c326f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:35.028291 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-36a6cb4e-0538-424c-8497-181de43c326f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:35.028994 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-36a6cb4e-0538-424c-8497-181de43c326f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:35.029782 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-36a6cb4e-0538-424c-8497-181de43c326f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:35.030400 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-36a6cb4e-0538-424c-8497-181de43c326f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:35.074945 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-06c5dd0f-f1ac-451e-a6cf-945edc2dbe72 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:35.075711 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-06c5dd0f-f1ac-451e-a6cf-945edc2dbe72 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:35.088197 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-06c5dd0f-f1ac-451e-a6cf-945edc2dbe72 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:35.088690 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-06c5dd0f-f1ac-451e-a6cf-945edc2dbe72 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:35.099564 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-06c5dd0f-f1ac-451e-a6cf-945edc2dbe72 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:35.100270 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-06c5dd0f-f1ac-451e-a6cf-945edc2dbe72 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:35.218032 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-36a6cb4e-0538-424c-8497-181de43c326f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:35.233337 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-36a6cb4e-0538-424c-8497-181de43c326f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:35.235107 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-36a6cb4e-0538-424c-8497-181de43c326f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:35.237318 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-36a6cb4e-0538-424c-8497-181de43c326f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.219602 Feb 21 04:14:35.238146 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 34/70] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:35 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:35.255608 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-bd6e8f85-cd07-4759-b9e8-b842818c99f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:35.256798 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-bd6e8f85-cd07-4759-b9e8-b842818c99f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:35.263126 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bd6e8f85-cd07-4759-b9e8-b842818c99f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:35.263580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bd6e8f85-cd07-4759-b9e8-b842818c99f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:35.264365 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bd6e8f85-cd07-4759-b9e8-b842818c99f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:35.265425 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bd6e8f85-cd07-4759-b9e8-b842818c99f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:35.291756 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-06c5dd0f-f1ac-451e-a6cf-945edc2dbe72 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:35.301112 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-06c5dd0f-f1ac-451e-a6cf-945edc2dbe72 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.229756 Feb 21 04:14:35.301809 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 37/71] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:35 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:35.381006 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-3b29194b-2db6-4d69-ba50-cd12f244a42d req-2f474ec6-dbe5-4019-a9ab-f8e6e6442a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c59a20-ff75-456f-99b3-070207d951d7", "tag": "ad4a893e-bbd1-41d8-a92a-483868402b5b"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:35.383302 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:14:35.383302 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:14:35.394525 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-3b29194b-2db6-4d69-ba50-cd12f244a42d req-2f474ec6-dbe5-4019-a9ab-f8e6e6442a3e service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:35.395334 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-3b29194b-2db6-4d69-ba50-cd12f244a42d req-2f474ec6-dbe5-4019-a9ab-f8e6e6442a3e service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:35.411774 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-3b29194b-2db6-4d69-ba50-cd12f244a42d req-2f474ec6-dbe5-4019-a9ab-f8e6e6442a3e service nova] Creating event network-changed:ad4a893e-bbd1-41d8-a92a-483868402b5b for instance c0c59a20-ff75-456f-99b3-070207d951d7 on hv-cinder-77398 Feb 21 04:14:35.419041 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-3b29194b-2db6-4d69-ba50-cd12f244a42d req-2f474ec6-dbe5-4019-a9ab-f8e6e6442a3e service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044478 Feb 21 04:14:35.420726 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 38/72] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:14:35.453246 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-bd6e8f85-cd07-4759-b9e8-b842818c99f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:35.460873 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-bd6e8f85-cd07-4759-b9e8-b842818c99f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.211481 Feb 21 04:14:35.461584 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 35/73] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:35 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:35.899819 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d2de1382-0666-4191-a972-89dcc00d0dd4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:35.900618 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d2de1382-0666-4191-a972-89dcc00d0dd4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:35.907578 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d2de1382-0666-4191-a972-89dcc00d0dd4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:35.907968 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d2de1382-0666-4191-a972-89dcc00d0dd4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:35.908785 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d2de1382-0666-4191-a972-89dcc00d0dd4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:35.909222 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d2de1382-0666-4191-a972-89dcc00d0dd4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:36.049386 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d2de1382-0666-4191-a972-89dcc00d0dd4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:36.056828 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d2de1382-0666-4191-a972-89dcc00d0dd4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.161241 Feb 21 04:14:36.057330 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 39/74] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:35 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:36.255659 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c285e300-a771-40ec-ba09-23bb79c81827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:36.256265 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c285e300-a771-40ec-ba09-23bb79c81827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:36.262177 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c285e300-a771-40ec-ba09-23bb79c81827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:36.262621 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c285e300-a771-40ec-ba09-23bb79c81827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:36.263392 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c285e300-a771-40ec-ba09-23bb79c81827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:36.263831 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c285e300-a771-40ec-ba09-23bb79c81827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:36.318606 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c3bb528a-b3fd-4dbe-8725-e8798bf274f2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:36.319212 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c3bb528a-b3fd-4dbe-8725-e8798bf274f2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:36.325057 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c3bb528a-b3fd-4dbe-8725-e8798bf274f2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:36.325500 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c3bb528a-b3fd-4dbe-8725-e8798bf274f2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:36.326278 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c3bb528a-b3fd-4dbe-8725-e8798bf274f2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:36.326707 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c3bb528a-b3fd-4dbe-8725-e8798bf274f2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:36.435384 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c285e300-a771-40ec-ba09-23bb79c81827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:36.444135 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c285e300-a771-40ec-ba09-23bb79c81827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:36.445899 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c285e300-a771-40ec-ba09-23bb79c81827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:36.447899 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c285e300-a771-40ec-ba09-23bb79c81827 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.196236 Feb 21 04:14:36.448597 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 36/75] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:36 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:36.478028 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7df67cd6-100c-4297-8efc-6ca3976ef7ff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:36.478805 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7df67cd6-100c-4297-8efc-6ca3976ef7ff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:36.486097 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7df67cd6-100c-4297-8efc-6ca3976ef7ff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:36.486548 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7df67cd6-100c-4297-8efc-6ca3976ef7ff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:36.487359 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7df67cd6-100c-4297-8efc-6ca3976ef7ff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:36.487796 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7df67cd6-100c-4297-8efc-6ca3976ef7ff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:36.500214 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c3bb528a-b3fd-4dbe-8725-e8798bf274f2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:36.508153 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c3bb528a-b3fd-4dbe-8725-e8798bf274f2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.193144 Feb 21 04:14:36.509215 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 40/76] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:36 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:36.624113 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7df67cd6-100c-4297-8efc-6ca3976ef7ff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:36.632245 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7df67cd6-100c-4297-8efc-6ca3976ef7ff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.157933 Feb 21 04:14:36.632907 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 37/77] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:36 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:37.073499 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-dc24328a-59bf-4bac-982e-44b188a07626 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:37.074023 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-dc24328a-59bf-4bac-982e-44b188a07626 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:37.079834 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc24328a-59bf-4bac-982e-44b188a07626 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:37.080281 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc24328a-59bf-4bac-982e-44b188a07626 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:37.081087 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc24328a-59bf-4bac-982e-44b188a07626 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:37.081518 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc24328a-59bf-4bac-982e-44b188a07626 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:37.211123 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dc24328a-59bf-4bac-982e-44b188a07626 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:37.219588 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-dc24328a-59bf-4bac-982e-44b188a07626 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.149276 Feb 21 04:14:37.220156 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 41/78] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:37 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:37.466661 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-53ee7a24-7c7f-4424-ab10-829bc12b50a1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:37.467264 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-53ee7a24-7c7f-4424-ab10-829bc12b50a1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:37.473565 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-53ee7a24-7c7f-4424-ab10-829bc12b50a1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:37.474006 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-53ee7a24-7c7f-4424-ab10-829bc12b50a1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:37.475031 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-53ee7a24-7c7f-4424-ab10-829bc12b50a1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:37.475466 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-53ee7a24-7c7f-4424-ab10-829bc12b50a1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:37.526048 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5e6ea137-d2b6-48c9-9f88-dab8a36d75c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:37.527346 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5e6ea137-d2b6-48c9-9f88-dab8a36d75c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:37.534363 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5e6ea137-d2b6-48c9-9f88-dab8a36d75c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:37.535004 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5e6ea137-d2b6-48c9-9f88-dab8a36d75c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:37.536155 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5e6ea137-d2b6-48c9-9f88-dab8a36d75c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:37.536599 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5e6ea137-d2b6-48c9-9f88-dab8a36d75c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:37.650269 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-53ee7a24-7c7f-4424-ab10-829bc12b50a1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:37.658841 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-53ee7a24-7c7f-4424-ab10-829bc12b50a1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:37.660343 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-53ee7a24-7c7f-4424-ab10-829bc12b50a1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:37.661453 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-53ee7a24-7c7f-4424-ab10-829bc12b50a1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.198578 Feb 21 04:14:37.662008 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 38/79] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:37 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:14:37.670131 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-da8eed76-2d7f-42dd-a567-e3d80fc869a3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:37.670816 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-da8eed76-2d7f-42dd-a567-e3d80fc869a3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:37.676802 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-da8eed76-2d7f-42dd-a567-e3d80fc869a3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:37.677342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-da8eed76-2d7f-42dd-a567-e3d80fc869a3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:37.678122 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-da8eed76-2d7f-42dd-a567-e3d80fc869a3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:37.678548 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-da8eed76-2d7f-42dd-a567-e3d80fc869a3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:37.710522 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5e6ea137-d2b6-48c9-9f88-dab8a36d75c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:37.718015 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5e6ea137-d2b6-48c9-9f88-dab8a36d75c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.196085 Feb 21 04:14:37.718537 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 42/80] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:37 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:37.807924 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-da8eed76-2d7f-42dd-a567-e3d80fc869a3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:37.815064 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-da8eed76-2d7f-42dd-a567-e3d80fc869a3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.148844 Feb 21 04:14:37.815627 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 39/81] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:37 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:38.235981 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-24426323-d8e6-44b7-afd5-4bd36cc9440f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:38.236897 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-24426323-d8e6-44b7-afd5-4bd36cc9440f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:38.245040 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-24426323-d8e6-44b7-afd5-4bd36cc9440f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:38.245846 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-24426323-d8e6-44b7-afd5-4bd36cc9440f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:38.247091 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-24426323-d8e6-44b7-afd5-4bd36cc9440f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:38.247403 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-24426323-d8e6-44b7-afd5-4bd36cc9440f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:38.392294 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-24426323-d8e6-44b7-afd5-4bd36cc9440f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:38.399540 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-24426323-d8e6-44b7-afd5-4bd36cc9440f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.167348 Feb 21 04:14:38.400110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 43/82] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:38 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:38.678926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0ece8f2f-c642-496f-a2a5-3e83ca532512 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:38.679536 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0ece8f2f-c642-496f-a2a5-3e83ca532512 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:38.685306 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0ece8f2f-c642-496f-a2a5-3e83ca532512 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:38.685757 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0ece8f2f-c642-496f-a2a5-3e83ca532512 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:38.686538 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0ece8f2f-c642-496f-a2a5-3e83ca532512 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:38.686973 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0ece8f2f-c642-496f-a2a5-3e83ca532512 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:38.735512 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-efb7e9e5-3645-4222-975b-1f9a7e34276d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:38.736161 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-efb7e9e5-3645-4222-975b-1f9a7e34276d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:38.741944 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-efb7e9e5-3645-4222-975b-1f9a7e34276d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:38.742442 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-efb7e9e5-3645-4222-975b-1f9a7e34276d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:38.743184 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-efb7e9e5-3645-4222-975b-1f9a7e34276d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:38.743622 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-efb7e9e5-3645-4222-975b-1f9a7e34276d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:38.846960 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0ece8f2f-c642-496f-a2a5-3e83ca532512 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:38.854737 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0ece8f2f-c642-496f-a2a5-3e83ca532512 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:38.856251 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0ece8f2f-c642-496f-a2a5-3e83ca532512 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:38.857394 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0ece8f2f-c642-496f-a2a5-3e83ca532512 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.182074 Feb 21 04:14:38.857960 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 40/83] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:38 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:14:38.869263 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-136f3b51-0dc7-41c3-bc8f-90ce0821eeee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:38.870046 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-136f3b51-0dc7-41c3-bc8f-90ce0821eeee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:38.876261 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-136f3b51-0dc7-41c3-bc8f-90ce0821eeee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:38.876959 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-136f3b51-0dc7-41c3-bc8f-90ce0821eeee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:38.877821 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-136f3b51-0dc7-41c3-bc8f-90ce0821eeee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:38.878288 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-136f3b51-0dc7-41c3-bc8f-90ce0821eeee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:38.934563 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-efb7e9e5-3645-4222-975b-1f9a7e34276d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:38.942350 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-efb7e9e5-3645-4222-975b-1f9a7e34276d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.210974 Feb 21 04:14:38.943480 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 44/84] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:38 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:39.024074 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-136f3b51-0dc7-41c3-bc8f-90ce0821eeee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:39.032219 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-136f3b51-0dc7-41c3-bc8f-90ce0821eeee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.172769 Feb 21 04:14:39.032916 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 41/85] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:38 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:39.416526 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6a8febb6-6052-4276-9c3e-0f629927a98e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:39.417445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6a8febb6-6052-4276-9c3e-0f629927a98e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:39.423478 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6a8febb6-6052-4276-9c3e-0f629927a98e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:39.424002 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6a8febb6-6052-4276-9c3e-0f629927a98e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:39.424826 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6a8febb6-6052-4276-9c3e-0f629927a98e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:39.425265 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6a8febb6-6052-4276-9c3e-0f629927a98e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:39.561366 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6a8febb6-6052-4276-9c3e-0f629927a98e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:39.569032 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6a8febb6-6052-4276-9c3e-0f629927a98e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.156082 Feb 21 04:14:39.569612 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 45/86] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:39 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:39.875939 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f874b7f3-467d-44ef-a218-78a55695fc6c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:39.877191 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f874b7f3-467d-44ef-a218-78a55695fc6c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:39.883156 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f874b7f3-467d-44ef-a218-78a55695fc6c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:39.883609 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f874b7f3-467d-44ef-a218-78a55695fc6c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:39.884438 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f874b7f3-467d-44ef-a218-78a55695fc6c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:39.884929 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f874b7f3-467d-44ef-a218-78a55695fc6c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:39.960055 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-260d9753-638b-409a-ac51-188edc96cc7d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:39.961030 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-260d9753-638b-409a-ac51-188edc96cc7d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:39.967115 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-260d9753-638b-409a-ac51-188edc96cc7d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:39.967642 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-260d9753-638b-409a-ac51-188edc96cc7d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:39.968457 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-260d9753-638b-409a-ac51-188edc96cc7d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:39.969056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-260d9753-638b-409a-ac51-188edc96cc7d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:40.046719 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f874b7f3-467d-44ef-a218-78a55695fc6c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:40.054509 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f874b7f3-467d-44ef-a218-78a55695fc6c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:40.056202 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f874b7f3-467d-44ef-a218-78a55695fc6c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:40.057335 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f874b7f3-467d-44ef-a218-78a55695fc6c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.185998 Feb 21 04:14:40.057893 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 42/87] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:39 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:40.062341 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ee2c9908-cc56-4e64-a3f5-fb7e79f510c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:40.063159 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ee2c9908-cc56-4e64-a3f5-fb7e79f510c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:40.069018 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ee2c9908-cc56-4e64-a3f5-fb7e79f510c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:40.069630 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ee2c9908-cc56-4e64-a3f5-fb7e79f510c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:40.070521 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ee2c9908-cc56-4e64-a3f5-fb7e79f510c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:40.071097 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ee2c9908-cc56-4e64-a3f5-fb7e79f510c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:40.146747 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-260d9753-638b-409a-ac51-188edc96cc7d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:40.154498 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-260d9753-638b-409a-ac51-188edc96cc7d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.198686 Feb 21 04:14:40.155077 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 46/88] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:39 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:40.220939 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ee2c9908-cc56-4e64-a3f5-fb7e79f510c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:40.228477 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ee2c9908-cc56-4e64-a3f5-fb7e79f510c5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.169381 Feb 21 04:14:40.229167 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 43/89] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:40 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:40.585507 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-2893227a-6a8c-4f1c-aa04-9968218e4f7d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:40.586219 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-2893227a-6a8c-4f1c-aa04-9968218e4f7d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:40.592200 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2893227a-6a8c-4f1c-aa04-9968218e4f7d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:40.592773 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2893227a-6a8c-4f1c-aa04-9968218e4f7d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:40.593612 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2893227a-6a8c-4f1c-aa04-9968218e4f7d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:40.594205 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2893227a-6a8c-4f1c-aa04-9968218e4f7d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:40.741118 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-2893227a-6a8c-4f1c-aa04-9968218e4f7d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:40.758512 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-2893227a-6a8c-4f1c-aa04-9968218e4f7d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.176377 Feb 21 04:14:40.759517 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 47/90] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:40 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:41.077072 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8cb4bd37-d612-4ca7-a1a7-4e52fda3ff14 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:41.077594 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8cb4bd37-d612-4ca7-a1a7-4e52fda3ff14 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:41.093991 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8cb4bd37-d612-4ca7-a1a7-4e52fda3ff14 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:41.094572 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8cb4bd37-d612-4ca7-a1a7-4e52fda3ff14 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:41.095399 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8cb4bd37-d612-4ca7-a1a7-4e52fda3ff14 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:41.095840 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8cb4bd37-d612-4ca7-a1a7-4e52fda3ff14 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:41.170951 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5dd571ce-4c66-4aea-a4bc-dbfaac0e6075 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:41.171582 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5dd571ce-4c66-4aea-a4bc-dbfaac0e6075 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:41.184891 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5dd571ce-4c66-4aea-a4bc-dbfaac0e6075 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:41.184891 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5dd571ce-4c66-4aea-a4bc-dbfaac0e6075 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:41.184891 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5dd571ce-4c66-4aea-a4bc-dbfaac0e6075 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:41.184891 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5dd571ce-4c66-4aea-a4bc-dbfaac0e6075 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:41.261191 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8cb4bd37-d612-4ca7-a1a7-4e52fda3ff14 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:41.268742 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8cb4bd37-d612-4ca7-a1a7-4e52fda3ff14 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:41.270263 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8cb4bd37-d612-4ca7-a1a7-4e52fda3ff14 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:41.271348 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8cb4bd37-d612-4ca7-a1a7-4e52fda3ff14 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.199889 Feb 21 04:14:41.271909 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 44/91] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:41 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:41.276097 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-38e93851-2892-46fb-ab67-325128f6c9a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:41.276716 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-38e93851-2892-46fb-ab67-325128f6c9a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:41.283071 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-38e93851-2892-46fb-ab67-325128f6c9a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:41.283615 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-38e93851-2892-46fb-ab67-325128f6c9a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:41.284384 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-38e93851-2892-46fb-ab67-325128f6c9a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:41.284914 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-38e93851-2892-46fb-ab67-325128f6c9a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:41.344615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5dd571ce-4c66-4aea-a4bc-dbfaac0e6075 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:41.351954 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5dd571ce-4c66-4aea-a4bc-dbfaac0e6075 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.184542 Feb 21 04:14:41.352530 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 48/92] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:41 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:41.431061 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-38e93851-2892-46fb-ab67-325128f6c9a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:41.438158 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-38e93851-2892-46fb-ab67-325128f6c9a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.165283 Feb 21 04:14:41.438722 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 45/93] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:41 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:41.776306 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-96c0a235-889b-4d20-a848-6b5571c8bd67 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:41.782922 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-96c0a235-889b-4d20-a848-6b5571c8bd67 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:41.792572 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-96c0a235-889b-4d20-a848-6b5571c8bd67 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:41.797379 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-96c0a235-889b-4d20-a848-6b5571c8bd67 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:41.798379 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-96c0a235-889b-4d20-a848-6b5571c8bd67 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:41.798817 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-96c0a235-889b-4d20-a848-6b5571c8bd67 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:41.935444 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-96c0a235-889b-4d20-a848-6b5571c8bd67 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:41.944549 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-96c0a235-889b-4d20-a848-6b5571c8bd67 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.173142 Feb 21 04:14:41.945943 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 49/94] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:41 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:42.290305 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fb0d5275-2e9c-4675-8875-4d7e9b9b3a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:42.290992 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fb0d5275-2e9c-4675-8875-4d7e9b9b3a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:42.299442 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb0d5275-2e9c-4675-8875-4d7e9b9b3a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:42.301869 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb0d5275-2e9c-4675-8875-4d7e9b9b3a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:42.307499 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb0d5275-2e9c-4675-8875-4d7e9b9b3a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:42.308172 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb0d5275-2e9c-4675-8875-4d7e9b9b3a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:42.369866 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-197eebec-7b1d-483f-b5ce-2266022600d8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:42.370649 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-197eebec-7b1d-483f-b5ce-2266022600d8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:42.380918 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-197eebec-7b1d-483f-b5ce-2266022600d8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:42.381430 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-197eebec-7b1d-483f-b5ce-2266022600d8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:42.382403 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-197eebec-7b1d-483f-b5ce-2266022600d8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:42.382999 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-197eebec-7b1d-483f-b5ce-2266022600d8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:42.527330 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fb0d5275-2e9c-4675-8875-4d7e9b9b3a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:42.537469 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fb0d5275-2e9c-4675-8875-4d7e9b9b3a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:42.538985 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fb0d5275-2e9c-4675-8875-4d7e9b9b3a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:42.540277 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fb0d5275-2e9c-4675-8875-4d7e9b9b3a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.254224 Feb 21 04:14:42.540880 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 46/95] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:42 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:42.545065 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-cd8dbed6-5fa4-464a-a7f2-d232e2d9f1de tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:42.545839 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-cd8dbed6-5fa4-464a-a7f2-d232e2d9f1de tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:42.553054 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cd8dbed6-5fa4-464a-a7f2-d232e2d9f1de tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:42.553765 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cd8dbed6-5fa4-464a-a7f2-d232e2d9f1de tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:42.554561 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cd8dbed6-5fa4-464a-a7f2-d232e2d9f1de tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:42.555034 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cd8dbed6-5fa4-464a-a7f2-d232e2d9f1de tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:42.585900 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-197eebec-7b1d-483f-b5ce-2266022600d8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:42.595804 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-197eebec-7b1d-483f-b5ce-2266022600d8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.229662 Feb 21 04:14:42.596498 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 50/96] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:42 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:42.695931 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-cd8dbed6-5fa4-464a-a7f2-d232e2d9f1de tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:42.703151 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-cd8dbed6-5fa4-464a-a7f2-d232e2d9f1de tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.161318 Feb 21 04:14:42.703705 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 47/97] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:42 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:42.962377 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7ff38df0-1c36-4961-90d7-655f9b828f2e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:42.962984 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7ff38df0-1c36-4961-90d7-655f9b828f2e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:42.969837 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ff38df0-1c36-4961-90d7-655f9b828f2e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:42.970282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ff38df0-1c36-4961-90d7-655f9b828f2e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:42.971066 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ff38df0-1c36-4961-90d7-655f9b828f2e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:42.971496 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ff38df0-1c36-4961-90d7-655f9b828f2e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:43.108915 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7ff38df0-1c36-4961-90d7-655f9b828f2e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:43.116664 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7ff38df0-1c36-4961-90d7-655f9b828f2e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.157900 Feb 21 04:14:43.117218 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 51/98] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:42 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:43.563550 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-44dc2895-8a20-4926-807f-2dc554f51c63 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:43.564960 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-44dc2895-8a20-4926-807f-2dc554f51c63 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:43.573203 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-44dc2895-8a20-4926-807f-2dc554f51c63 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:43.573795 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-44dc2895-8a20-4926-807f-2dc554f51c63 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:43.574961 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-44dc2895-8a20-4926-807f-2dc554f51c63 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:43.575531 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-44dc2895-8a20-4926-807f-2dc554f51c63 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:43.612842 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-71b315b3-6f1f-45ac-ad6a-1fe82848149a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:43.613745 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-71b315b3-6f1f-45ac-ad6a-1fe82848149a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:43.624985 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-71b315b3-6f1f-45ac-ad6a-1fe82848149a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:43.625538 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-71b315b3-6f1f-45ac-ad6a-1fe82848149a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:43.626510 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-71b315b3-6f1f-45ac-ad6a-1fe82848149a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:43.627020 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-71b315b3-6f1f-45ac-ad6a-1fe82848149a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:43.801086 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-44dc2895-8a20-4926-807f-2dc554f51c63 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:43.809235 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-44dc2895-8a20-4926-807f-2dc554f51c63 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:43.810689 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-44dc2895-8a20-4926-807f-2dc554f51c63 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:43.812225 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-44dc2895-8a20-4926-807f-2dc554f51c63 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.253975 Feb 21 04:14:43.813742 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 48/99] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:43 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:14:43.829233 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c500daf0-8e33-4a24-b727-680a6f4bb7f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:43.830013 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c500daf0-8e33-4a24-b727-680a6f4bb7f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:43.837735 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c500daf0-8e33-4a24-b727-680a6f4bb7f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:43.838276 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c500daf0-8e33-4a24-b727-680a6f4bb7f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:43.839237 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c500daf0-8e33-4a24-b727-680a6f4bb7f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:43.839673 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c500daf0-8e33-4a24-b727-680a6f4bb7f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:43.900366 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-71b315b3-6f1f-45ac-ad6a-1fe82848149a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:43.910197 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-71b315b3-6f1f-45ac-ad6a-1fe82848149a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.301545 Feb 21 04:14:43.921248 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 52/100] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:43 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:44.020606 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c500daf0-8e33-4a24-b727-680a6f4bb7f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:44.027809 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c500daf0-8e33-4a24-b727-680a6f4bb7f1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.202688 Feb 21 04:14:44.028646 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 49/101] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:43 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:44.133432 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a6d858af-f460-4420-9b0b-eccee7b1b3c7 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:44.134098 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a6d858af-f460-4420-9b0b-eccee7b1b3c7 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:44.141448 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6d858af-f460-4420-9b0b-eccee7b1b3c7 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:44.141915 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6d858af-f460-4420-9b0b-eccee7b1b3c7 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:44.142709 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6d858af-f460-4420-9b0b-eccee7b1b3c7 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:44.143151 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6d858af-f460-4420-9b0b-eccee7b1b3c7 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:44.356105 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a6d858af-f460-4420-9b0b-eccee7b1b3c7 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:44.363915 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a6d858af-f460-4420-9b0b-eccee7b1b3c7 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.234630 Feb 21 04:14:44.364482 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 53/102] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:44 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:44.831763 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-dc5f3342-c27a-42e0-a69c-f0f022523ed6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:44.833036 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-dc5f3342-c27a-42e0-a69c-f0f022523ed6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:44.844346 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc5f3342-c27a-42e0-a69c-f0f022523ed6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:44.846686 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc5f3342-c27a-42e0-a69c-f0f022523ed6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:44.849706 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc5f3342-c27a-42e0-a69c-f0f022523ed6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:44.850567 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc5f3342-c27a-42e0-a69c-f0f022523ed6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:44.928982 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-26911725-53c7-485b-bdd7-f7e45008b1cc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:44.930128 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-26911725-53c7-485b-bdd7-f7e45008b1cc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:44.948539 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26911725-53c7-485b-bdd7-f7e45008b1cc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:44.949536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26911725-53c7-485b-bdd7-f7e45008b1cc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:44.952834 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26911725-53c7-485b-bdd7-f7e45008b1cc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:44.954483 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26911725-53c7-485b-bdd7-f7e45008b1cc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:45.177091 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-dc5f3342-c27a-42e0-a69c-f0f022523ed6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:45.189147 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-dc5f3342-c27a-42e0-a69c-f0f022523ed6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:45.191037 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-dc5f3342-c27a-42e0-a69c-f0f022523ed6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:45.192683 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-dc5f3342-c27a-42e0-a69c-f0f022523ed6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.365929 Feb 21 04:14:45.194309 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 50/103] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:44 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:45.209570 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f79f1651-926b-44ac-bd98-b987ec0de01d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:45.211080 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f79f1651-926b-44ac-bd98-b987ec0de01d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:45.218484 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f79f1651-926b-44ac-bd98-b987ec0de01d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:45.219511 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f79f1651-926b-44ac-bd98-b987ec0de01d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:45.220715 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f79f1651-926b-44ac-bd98-b987ec0de01d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:45.222586 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f79f1651-926b-44ac-bd98-b987ec0de01d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:45.279009 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-26911725-53c7-485b-bdd7-f7e45008b1cc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:45.288729 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-26911725-53c7-485b-bdd7-f7e45008b1cc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.363630 Feb 21 04:14:45.290734 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 54/104] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:44 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:45.381012 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a1e9da68-8468-49db-8db5-a5450ef9fe6e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:45.381673 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a1e9da68-8468-49db-8db5-a5450ef9fe6e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:45.388536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a1e9da68-8468-49db-8db5-a5450ef9fe6e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:45.389174 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a1e9da68-8468-49db-8db5-a5450ef9fe6e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:45.391332 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a1e9da68-8468-49db-8db5-a5450ef9fe6e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:45.391765 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a1e9da68-8468-49db-8db5-a5450ef9fe6e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:45.434459 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f79f1651-926b-44ac-bd98-b987ec0de01d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:45.444762 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f79f1651-926b-44ac-bd98-b987ec0de01d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.246517 Feb 21 04:14:45.445648 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 51/105] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:45 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:45.571883 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a1e9da68-8468-49db-8db5-a5450ef9fe6e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:45.580038 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a1e9da68-8468-49db-8db5-a5450ef9fe6e tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.203308 Feb 21 04:14:45.580615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 55/106] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:45 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:46.211295 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-39324571-7df1-4ff5-9df5-be8c5d4e9d2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:46.211902 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-39324571-7df1-4ff5-9df5-be8c5d4e9d2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:46.219570 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-39324571-7df1-4ff5-9df5-be8c5d4e9d2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:46.219980 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-39324571-7df1-4ff5-9df5-be8c5d4e9d2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:46.221713 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-39324571-7df1-4ff5-9df5-be8c5d4e9d2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:46.222314 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-39324571-7df1-4ff5-9df5-be8c5d4e9d2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:46.309068 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3594ad6e-e5d3-42dc-904e-6a529c598392 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:46.310267 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3594ad6e-e5d3-42dc-904e-6a529c598392 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:46.320484 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3594ad6e-e5d3-42dc-904e-6a529c598392 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:46.329138 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3594ad6e-e5d3-42dc-904e-6a529c598392 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:46.335110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3594ad6e-e5d3-42dc-904e-6a529c598392 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:46.337169 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3594ad6e-e5d3-42dc-904e-6a529c598392 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:46.567068 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-39324571-7df1-4ff5-9df5-be8c5d4e9d2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:46.577392 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-39324571-7df1-4ff5-9df5-be8c5d4e9d2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:46.581177 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-39324571-7df1-4ff5-9df5-be8c5d4e9d2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:46.583661 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-39324571-7df1-4ff5-9df5-be8c5d4e9d2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.375833 Feb 21 04:14:46.585379 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 52/107] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:46 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:46.591471 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8d65e813-40dd-43ff-aeac-58b725a44d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:46.592984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8d65e813-40dd-43ff-aeac-58b725a44d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:46.600107 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8d65e813-40dd-43ff-aeac-58b725a44d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:46.600906 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8d65e813-40dd-43ff-aeac-58b725a44d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:46.601818 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8d65e813-40dd-43ff-aeac-58b725a44d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:46.602490 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8d65e813-40dd-43ff-aeac-58b725a44d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:46.662700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-3594ad6e-e5d3-42dc-904e-6a529c598392 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:46.676071 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3594ad6e-e5d3-42dc-904e-6a529c598392 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.371920 Feb 21 04:14:46.676705 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 56/108] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:46 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:46.681461 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4b95b325-2da1-4b0b-810f-cfc4b842932a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:46.682066 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4b95b325-2da1-4b0b-810f-cfc4b842932a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:46.688416 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4b95b325-2da1-4b0b-810f-cfc4b842932a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:46.690242 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4b95b325-2da1-4b0b-810f-cfc4b842932a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:46.691250 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4b95b325-2da1-4b0b-810f-cfc4b842932a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:46.691949 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4b95b325-2da1-4b0b-810f-cfc4b842932a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:46.984024 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8d65e813-40dd-43ff-aeac-58b725a44d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:46.991593 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8d65e813-40dd-43ff-aeac-58b725a44d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.404969 Feb 21 04:14:46.992168 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 53/109] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:46 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:47.056470 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4b95b325-2da1-4b0b-810f-cfc4b842932a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:47.064806 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4b95b325-2da1-4b0b-810f-cfc4b842932a tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.386881 Feb 21 04:14:47.065514 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 57/110] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:46 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:47.602212 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2e014e5b-6d23-483a-84b1-1a2b7dae85cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:47.602813 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2e014e5b-6d23-483a-84b1-1a2b7dae85cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:47.608665 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e014e5b-6d23-483a-84b1-1a2b7dae85cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:47.609099 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e014e5b-6d23-483a-84b1-1a2b7dae85cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:47.610405 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e014e5b-6d23-483a-84b1-1a2b7dae85cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:47.610827 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e014e5b-6d23-483a-84b1-1a2b7dae85cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:47.702150 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9d9f61ba-3010-4d94-8b7f-0b6a53d19e8d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:47.703385 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9d9f61ba-3010-4d94-8b7f-0b6a53d19e8d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:47.713430 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9d9f61ba-3010-4d94-8b7f-0b6a53d19e8d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:47.717209 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9d9f61ba-3010-4d94-8b7f-0b6a53d19e8d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:47.719742 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9d9f61ba-3010-4d94-8b7f-0b6a53d19e8d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:47.720780 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9d9f61ba-3010-4d94-8b7f-0b6a53d19e8d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:47.779205 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2e014e5b-6d23-483a-84b1-1a2b7dae85cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:47.790079 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2e014e5b-6d23-483a-84b1-1a2b7dae85cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:47.791937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2e014e5b-6d23-483a-84b1-1a2b7dae85cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:47.796381 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2e014e5b-6d23-483a-84b1-1a2b7dae85cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.196753 Feb 21 04:14:47.800689 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 54/111] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:47 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:14:47.921146 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9d9f61ba-3010-4d94-8b7f-0b6a53d19e8d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:47.929417 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9d9f61ba-3010-4d94-8b7f-0b6a53d19e8d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.237830 Feb 21 04:14:47.930235 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 58/112] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:47 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:48.009831 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d3a4cadb-ff5a-4e58-a723-080afd35c31e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:48.010709 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d3a4cadb-ff5a-4e58-a723-080afd35c31e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:48.017527 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d3a4cadb-ff5a-4e58-a723-080afd35c31e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:48.018149 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d3a4cadb-ff5a-4e58-a723-080afd35c31e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:48.019121 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d3a4cadb-ff5a-4e58-a723-080afd35c31e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:48.019845 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d3a4cadb-ff5a-4e58-a723-080afd35c31e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:48.081777 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-329a6447-f1bb-4624-b5f6-aa93b3b90b57 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:48.082775 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-329a6447-f1bb-4624-b5f6-aa93b3b90b57 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:48.094446 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-329a6447-f1bb-4624-b5f6-aa93b3b90b57 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:48.096366 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-329a6447-f1bb-4624-b5f6-aa93b3b90b57 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:48.097395 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-329a6447-f1bb-4624-b5f6-aa93b3b90b57 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:48.097836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-329a6447-f1bb-4624-b5f6-aa93b3b90b57 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:48.292617 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d3a4cadb-ff5a-4e58-a723-080afd35c31e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:48.306109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d3a4cadb-ff5a-4e58-a723-080afd35c31e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.300519 Feb 21 04:14:48.307315 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 55/113] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:48 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:48.334734 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-329a6447-f1bb-4624-b5f6-aa93b3b90b57 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:48.342111 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-329a6447-f1bb-4624-b5f6-aa93b3b90b57 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.264414 Feb 21 04:14:48.343029 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 59/114] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:48 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:48.815617 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-76912558-e9fb-4c13-be68-80ec5cab6ec9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:48.816409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-76912558-e9fb-4c13-be68-80ec5cab6ec9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:48.822769 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-76912558-e9fb-4c13-be68-80ec5cab6ec9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:48.823279 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-76912558-e9fb-4c13-be68-80ec5cab6ec9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:48.824275 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-76912558-e9fb-4c13-be68-80ec5cab6ec9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:48.824945 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-76912558-e9fb-4c13-be68-80ec5cab6ec9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:48.946121 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-11587b8b-4d16-4ea6-a5b7-a26a3a1e6407 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:48.946731 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-11587b8b-4d16-4ea6-a5b7-a26a3a1e6407 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:48.952734 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-11587b8b-4d16-4ea6-a5b7-a26a3a1e6407 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:48.953475 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-11587b8b-4d16-4ea6-a5b7-a26a3a1e6407 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:48.954414 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-11587b8b-4d16-4ea6-a5b7-a26a3a1e6407 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:48.954994 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-11587b8b-4d16-4ea6-a5b7-a26a3a1e6407 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:48.977221 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-76912558-e9fb-4c13-be68-80ec5cab6ec9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:48.985634 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-76912558-e9fb-4c13-be68-80ec5cab6ec9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:48.987295 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-76912558-e9fb-4c13-be68-80ec5cab6ec9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:48.988497 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-76912558-e9fb-4c13-be68-80ec5cab6ec9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.177248 Feb 21 04:14:48.999680 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 56/115] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:48 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:49.164345 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-11587b8b-4d16-4ea6-a5b7-a26a3a1e6407 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:49.179919 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-11587b8b-4d16-4ea6-a5b7-a26a3a1e6407 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.237349 Feb 21 04:14:49.181213 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 60/116] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:48 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:49.324611 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0dd81c39-913f-42fd-b948-cf2522165e3e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:49.326067 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0dd81c39-913f-42fd-b948-cf2522165e3e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:49.333413 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0dd81c39-913f-42fd-b948-cf2522165e3e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:49.334218 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0dd81c39-913f-42fd-b948-cf2522165e3e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:49.335149 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0dd81c39-913f-42fd-b948-cf2522165e3e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:49.335722 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0dd81c39-913f-42fd-b948-cf2522165e3e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:49.371078 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-962bc295-573e-49fa-8b7a-760bb4023d8c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:49.372088 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-962bc295-573e-49fa-8b7a-760bb4023d8c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:49.380250 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-962bc295-573e-49fa-8b7a-760bb4023d8c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:49.381603 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-962bc295-573e-49fa-8b7a-760bb4023d8c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:49.385893 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-962bc295-573e-49fa-8b7a-760bb4023d8c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:49.386504 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-962bc295-573e-49fa-8b7a-760bb4023d8c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:49.710564 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0dd81c39-913f-42fd-b948-cf2522165e3e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:49.725138 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0dd81c39-913f-42fd-b948-cf2522165e3e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.400052 Feb 21 04:14:49.725936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 57/117] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:49 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:49.745543 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-962bc295-573e-49fa-8b7a-760bb4023d8c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:49.756348 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-962bc295-573e-49fa-8b7a-760bb4023d8c tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.395110 Feb 21 04:14:49.757202 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 61/118] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:49 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:49.888174 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-d80e03bf-70ec-4697-a563-ec38518118ae req-24567214-63d8-4081-a156-c97edd6a3173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c2ec47-cdd2-4f7a-a523-8afdb8f2656d", "name": "network-vif-plugged", "status": "completed", "tag": "9dcd026b-bef5-4076-bab8-0b8c1cff42f3"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:49.891029 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:14:49.891029 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:14:49.901560 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-d80e03bf-70ec-4697-a563-ec38518118ae req-24567214-63d8-4081-a156-c97edd6a3173 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:49.902780 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-d80e03bf-70ec-4697-a563-ec38518118ae req-24567214-63d8-4081-a156-c97edd6a3173 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:49.925794 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-d80e03bf-70ec-4697-a563-ec38518118ae req-24567214-63d8-4081-a156-c97edd6a3173 service nova] Creating event network-vif-plugged:9dcd026b-bef5-4076-bab8-0b8c1cff42f3 for instance 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d on hv-cinder-77398 Feb 21 04:14:49.926319 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-d80e03bf-70ec-4697-a563-ec38518118ae req-24567214-63d8-4081-a156-c97edd6a3173 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 21 04:14:49.927683 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-63173b92-f728-4700-b79a-e670e1ded6f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:49.928283 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-63173b92-f728-4700-b79a-e670e1ded6f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:49.929233 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-63173b92-f728-4700-b79a-e670e1ded6f3 None None] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:49.929868 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-63173b92-f728-4700-b79a-e670e1ded6f3 None None] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:49.939499 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.compute.rpcapi [None req-63173b92-f728-4700-b79a-e670e1ded6f3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 21 04:14:49.940672 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-63173b92-f728-4700-b79a-e670e1ded6f3 None None] Releasing lock "compute-rpcapi-router" {{(pid=116570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 21 04:14:49.962070 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-63173b92-f728-4700-b79a-e670e1ded6f3 None None] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234579 Feb 21 04:14:49.963852 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 58/119] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:14:50.008590 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-390634b0-d811-4fca-9da1-b8bd919d6c83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:50.010033 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-390634b0-d811-4fca-9da1-b8bd919d6c83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:50.018754 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-390634b0-d811-4fca-9da1-b8bd919d6c83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:50.019660 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-390634b0-d811-4fca-9da1-b8bd919d6c83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:50.020885 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-390634b0-d811-4fca-9da1-b8bd919d6c83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:50.021462 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-390634b0-d811-4fca-9da1-b8bd919d6c83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:50.200046 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2e5329f3-363e-464b-bc73-bc4ee4f04af0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:50.201424 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2e5329f3-363e-464b-bc73-bc4ee4f04af0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:50.209291 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-390634b0-d811-4fca-9da1-b8bd919d6c83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:50.224179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-390634b0-d811-4fca-9da1-b8bd919d6c83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:50.226011 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e5329f3-363e-464b-bc73-bc4ee4f04af0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:50.227545 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e5329f3-363e-464b-bc73-bc4ee4f04af0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:50.227897 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-390634b0-d811-4fca-9da1-b8bd919d6c83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:50.229437 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e5329f3-363e-464b-bc73-bc4ee4f04af0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:50.230110 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e5329f3-363e-464b-bc73-bc4ee4f04af0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:50.232770 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-390634b0-d811-4fca-9da1-b8bd919d6c83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.229030 Feb 21 04:14:50.245126 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 62/120] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:50 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:50.471455 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2e5329f3-363e-464b-bc73-bc4ee4f04af0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:50.483168 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2e5329f3-363e-464b-bc73-bc4ee4f04af0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.289304 Feb 21 04:14:50.484013 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 59/121] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:50 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:50.748578 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6034de87-f6ea-416d-8aa5-eaaf83dbaaf0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:50.749224 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6034de87-f6ea-416d-8aa5-eaaf83dbaaf0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:50.762162 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6034de87-f6ea-416d-8aa5-eaaf83dbaaf0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:50.762836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6034de87-f6ea-416d-8aa5-eaaf83dbaaf0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:50.763659 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6034de87-f6ea-416d-8aa5-eaaf83dbaaf0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:50.764096 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6034de87-f6ea-416d-8aa5-eaaf83dbaaf0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:50.774265 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b8bc65e8-fa33-40db-b638-a7212b6c46cd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:50.774883 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b8bc65e8-fa33-40db-b638-a7212b6c46cd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:50.785165 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8bc65e8-fa33-40db-b638-a7212b6c46cd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:50.785623 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8bc65e8-fa33-40db-b638-a7212b6c46cd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:50.786543 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8bc65e8-fa33-40db-b638-a7212b6c46cd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:50.786840 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8bc65e8-fa33-40db-b638-a7212b6c46cd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:51.050005 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6034de87-f6ea-416d-8aa5-eaaf83dbaaf0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:51.065110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6034de87-f6ea-416d-8aa5-eaaf83dbaaf0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.319997 Feb 21 04:14:51.069413 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 63/122] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:50 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:51.115108 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b8bc65e8-fa33-40db-b638-a7212b6c46cd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:51.122818 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b8bc65e8-fa33-40db-b638-a7212b6c46cd tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.352116 Feb 21 04:14:51.124653 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 60/123] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:50 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:51.253740 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-efb93567-4aa8-4879-9843-7946ec474133 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:51.254851 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-efb93567-4aa8-4879-9843-7946ec474133 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:51.261373 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-efb93567-4aa8-4879-9843-7946ec474133 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:51.262140 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-efb93567-4aa8-4879-9843-7946ec474133 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:51.264177 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-efb93567-4aa8-4879-9843-7946ec474133 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:51.265036 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-efb93567-4aa8-4879-9843-7946ec474133 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:51.427357 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-efb93567-4aa8-4879-9843-7946ec474133 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:51.435892 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-efb93567-4aa8-4879-9843-7946ec474133 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:51.438618 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-efb93567-4aa8-4879-9843-7946ec474133 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:51.440581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-efb93567-4aa8-4879-9843-7946ec474133 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.191841 Feb 21 04:14:51.441363 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 64/124] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:51 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:14:51.502075 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-422160e0-bb31-462f-8355-798147a2032b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:51.511140 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-422160e0-bb31-462f-8355-798147a2032b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:51.527606 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-422160e0-bb31-462f-8355-798147a2032b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:51.528829 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-422160e0-bb31-462f-8355-798147a2032b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:51.529811 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-422160e0-bb31-462f-8355-798147a2032b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:51.530523 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-422160e0-bb31-462f-8355-798147a2032b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:51.715179 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-422160e0-bb31-462f-8355-798147a2032b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:51.723893 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-422160e0-bb31-462f-8355-798147a2032b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.226570 Feb 21 04:14:51.724465 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 61/125] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:51 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:51.981999 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-1948fadc-c6cf-4069-bc7a-6eec0af9c317 req-bc72b14a-72dd-4311-a4eb-f13895f50dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbdc0a4-bc84-45b4-ab5f-5a38689d0b41", "name": "network-vif-plugged", "status": "completed", "tag": "81c2bfeb-6e2e-4b6e-a06d-1af7c280bad5"}, {"server_uuid": "c0c59a20-ff75-456f-99b3-070207d951d7", "name": "network-vif-plugged", "status": "completed", "tag": "ad4a893e-bbd1-41d8-a92a-483868402b5b"}, {"server_uuid": "08569093-3abd-43da-8dc2-605b9a289ccf", "name": "network-vif-plugged", "status": "completed", "tag": "18fcec87-d164-4874-b7ec-0a2d9c6fb0df"}, {"server_uuid": "d58885ac-0561-4c6d-bdb4-97e629c9acaa", "name": "network-vif-plugged", "status": "completed", "tag": "fc039608-7f10-4b0d-b3ce-2ecd0aa5274d"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:51.984442 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:14:51.984442 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:14:51.993109 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-1948fadc-c6cf-4069-bc7a-6eec0af9c317 req-bc72b14a-72dd-4311-a4eb-f13895f50dd8 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:51.993578 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-1948fadc-c6cf-4069-bc7a-6eec0af9c317 req-bc72b14a-72dd-4311-a4eb-f13895f50dd8 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:52.032857 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-1948fadc-c6cf-4069-bc7a-6eec0af9c317 req-bc72b14a-72dd-4311-a4eb-f13895f50dd8 service nova] Creating event network-vif-plugged:81c2bfeb-6e2e-4b6e-a06d-1af7c280bad5 for instance efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 on hv-cinder-77398 Feb 21 04:14:52.033385 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-1948fadc-c6cf-4069-bc7a-6eec0af9c317 req-bc72b14a-72dd-4311-a4eb-f13895f50dd8 service nova] Creating event network-vif-plugged:ad4a893e-bbd1-41d8-a92a-483868402b5b for instance c0c59a20-ff75-456f-99b3-070207d951d7 on hv-cinder-77398 Feb 21 04:14:52.033882 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-1948fadc-c6cf-4069-bc7a-6eec0af9c317 req-bc72b14a-72dd-4311-a4eb-f13895f50dd8 service nova] Creating event network-vif-plugged:18fcec87-d164-4874-b7ec-0a2d9c6fb0df for instance 08569093-3abd-43da-8dc2-605b9a289ccf on hv-cinder-77398 Feb 21 04:14:52.034383 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-1948fadc-c6cf-4069-bc7a-6eec0af9c317 req-bc72b14a-72dd-4311-a4eb-f13895f50dd8 service nova] Creating event network-vif-plugged:fc039608-7f10-4b0d-b3ce-2ecd0aa5274d for instance d58885ac-0561-4c6d-bdb4-97e629c9acaa on hv-cinder-77398 Feb 21 04:14:52.055525 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-1948fadc-c6cf-4069-bc7a-6eec0af9c317 req-bc72b14a-72dd-4311-a4eb-f13895f50dd8 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.075609 Feb 21 04:14:52.056150 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 65/126] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:14:52.091383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fd258020-580d-415f-8833-42f4ca8f4602 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:52.095117 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fd258020-580d-415f-8833-42f4ca8f4602 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:52.122703 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fd258020-580d-415f-8833-42f4ca8f4602 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:52.125651 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fd258020-580d-415f-8833-42f4ca8f4602 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:52.127708 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fd258020-580d-415f-8833-42f4ca8f4602 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:52.129318 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fd258020-580d-415f-8833-42f4ca8f4602 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:52.142527 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-2c10b0e3-6921-4458-b2d5-cb5c6e70cd3b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:52.143410 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-2c10b0e3-6921-4458-b2d5-cb5c6e70cd3b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:52.161762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2c10b0e3-6921-4458-b2d5-cb5c6e70cd3b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:52.162444 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2c10b0e3-6921-4458-b2d5-cb5c6e70cd3b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:52.163291 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2c10b0e3-6921-4458-b2d5-cb5c6e70cd3b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:52.163730 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2c10b0e3-6921-4458-b2d5-cb5c6e70cd3b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:52.617705 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-2c10b0e3-6921-4458-b2d5-cb5c6e70cd3b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:52.627950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fd258020-580d-415f-8833-42f4ca8f4602 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:52.628881 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-2c10b0e3-6921-4458-b2d5-cb5c6e70cd3b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.490999 Feb 21 04:14:52.629621 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 66/127] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:52 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:52.635528 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fd258020-580d-415f-8833-42f4ca8f4602 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.553804 Feb 21 04:14:52.636097 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 62/128] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:52 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:52.641930 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e02f7435-0428-47b9-8f8d-950d4728dd4a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:52.646417 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e02f7435-0428-47b9-8f8d-950d4728dd4a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:52.652340 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e02f7435-0428-47b9-8f8d-950d4728dd4a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:52.653325 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e02f7435-0428-47b9-8f8d-950d4728dd4a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:52.653927 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e02f7435-0428-47b9-8f8d-950d4728dd4a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:52.654387 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e02f7435-0428-47b9-8f8d-950d4728dd4a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:52.745168 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e74d8d57-0f30-483c-a2d9-a9462e4d1ec2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:52.746833 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e74d8d57-0f30-483c-a2d9-a9462e4d1ec2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:52.754873 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e74d8d57-0f30-483c-a2d9-a9462e4d1ec2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:52.755314 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e74d8d57-0f30-483c-a2d9-a9462e4d1ec2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:52.756128 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e74d8d57-0f30-483c-a2d9-a9462e4d1ec2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:52.756559 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e74d8d57-0f30-483c-a2d9-a9462e4d1ec2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:52.805487 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e02f7435-0428-47b9-8f8d-950d4728dd4a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:52.814443 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e02f7435-0428-47b9-8f8d-950d4728dd4a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:52.816107 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e02f7435-0428-47b9-8f8d-950d4728dd4a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:52.817266 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e02f7435-0428-47b9-8f8d-950d4728dd4a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.186536 Feb 21 04:14:52.817837 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 67/129] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:52 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:52.900397 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e74d8d57-0f30-483c-a2d9-a9462e4d1ec2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:52.908566 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e74d8d57-0f30-483c-a2d9-a9462e4d1ec2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.169866 Feb 21 04:14:52.909160 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 63/130] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:52 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:53.645552 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-439796b4-8583-4358-8095-01d69fb5a7c4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:53.646741 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-439796b4-8583-4358-8095-01d69fb5a7c4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:53.651226 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4af2d430-ce87-4054-9789-752fb4b0eefe tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:53.651824 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4af2d430-ce87-4054-9789-752fb4b0eefe tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:53.653330 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-439796b4-8583-4358-8095-01d69fb5a7c4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:53.653776 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-439796b4-8583-4358-8095-01d69fb5a7c4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:53.654547 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-439796b4-8583-4358-8095-01d69fb5a7c4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:53.654977 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-439796b4-8583-4358-8095-01d69fb5a7c4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:53.658975 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4af2d430-ce87-4054-9789-752fb4b0eefe tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:53.659520 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4af2d430-ce87-4054-9789-752fb4b0eefe tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:53.660342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4af2d430-ce87-4054-9789-752fb4b0eefe tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:53.660890 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4af2d430-ce87-4054-9789-752fb4b0eefe tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:53.865242 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-439796b4-8583-4358-8095-01d69fb5a7c4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:53.869297 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4af2d430-ce87-4054-9789-752fb4b0eefe tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:53.873246 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-439796b4-8583-4358-8095-01d69fb5a7c4 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.231267 Feb 21 04:14:53.873847 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 68/131] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:53 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:53.878292 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d9d3fd9a-f05a-4833-910a-8225458b1e5a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:53.878969 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d9d3fd9a-f05a-4833-910a-8225458b1e5a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:53.879100 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4af2d430-ce87-4054-9789-752fb4b0eefe tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.231537 Feb 21 04:14:53.881073 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 64/132] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:53 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:53.885381 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d9d3fd9a-f05a-4833-910a-8225458b1e5a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:53.885817 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d9d3fd9a-f05a-4833-910a-8225458b1e5a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:53.886803 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d9d3fd9a-f05a-4833-910a-8225458b1e5a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:53.887229 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d9d3fd9a-f05a-4833-910a-8225458b1e5a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:53.927722 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-09335507-ed21-475b-95ad-e274f51a90e4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:53.928336 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-09335507-ed21-475b-95ad-e274f51a90e4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:53.934203 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-09335507-ed21-475b-95ad-e274f51a90e4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:53.934653 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-09335507-ed21-475b-95ad-e274f51a90e4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:53.935434 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-09335507-ed21-475b-95ad-e274f51a90e4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:53.935867 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-09335507-ed21-475b-95ad-e274f51a90e4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:54.060681 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d9d3fd9a-f05a-4833-910a-8225458b1e5a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:54.069157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d9d3fd9a-f05a-4833-910a-8225458b1e5a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:54.070697 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d9d3fd9a-f05a-4833-910a-8225458b1e5a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:54.071852 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d9d3fd9a-f05a-4833-910a-8225458b1e5a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.196867 Feb 21 04:14:54.082797 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 69/133] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:53 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:54.129929 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-09335507-ed21-475b-95ad-e274f51a90e4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:54.138210 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-09335507-ed21-475b-95ad-e274f51a90e4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.216500 Feb 21 04:14:54.139529 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 65/134] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:53 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:54.890215 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4f4913fe-1dc2-4d33-acec-23b28d55116f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:54.890860 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4f4913fe-1dc2-4d33-acec-23b28d55116f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:54.897212 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4f4913fe-1dc2-4d33-acec-23b28d55116f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:54.897669 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4f4913fe-1dc2-4d33-acec-23b28d55116f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:54.897785 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-34a12bea-44f4-439d-b9c1-ecd0c6f3eaf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:54.898397 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-34a12bea-44f4-439d-b9c1-ecd0c6f3eaf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:54.898503 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4f4913fe-1dc2-4d33-acec-23b28d55116f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:54.898887 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4f4913fe-1dc2-4d33-acec-23b28d55116f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:54.905460 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-34a12bea-44f4-439d-b9c1-ecd0c6f3eaf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:54.905912 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-34a12bea-44f4-439d-b9c1-ecd0c6f3eaf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:54.906747 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-34a12bea-44f4-439d-b9c1-ecd0c6f3eaf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:54.907209 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-34a12bea-44f4-439d-b9c1-ecd0c6f3eaf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:55.099975 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-34a12bea-44f4-439d-b9c1-ecd0c6f3eaf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:55.102539 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4f4913fe-1dc2-4d33-acec-23b28d55116f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:55.107732 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-34a12bea-44f4-439d-b9c1-ecd0c6f3eaf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.213919 Feb 21 04:14:55.108304 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 66/135] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:54 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:55.110294 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4f4913fe-1dc2-4d33-acec-23b28d55116f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.223683 Feb 21 04:14:55.111018 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 70/136] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:54 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:55.119732 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5153d1aa-adb2-46de-8d33-02af89ac7bd9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:55.119732 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5153d1aa-adb2-46de-8d33-02af89ac7bd9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:55.120032 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5153d1aa-adb2-46de-8d33-02af89ac7bd9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:55.120483 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5153d1aa-adb2-46de-8d33-02af89ac7bd9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:55.121284 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5153d1aa-adb2-46de-8d33-02af89ac7bd9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:55.121707 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5153d1aa-adb2-46de-8d33-02af89ac7bd9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:55.156675 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1d7dc74d-1317-41ef-bc1b-4892d9f7a955 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:55.157576 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1d7dc74d-1317-41ef-bc1b-4892d9f7a955 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:55.163564 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1d7dc74d-1317-41ef-bc1b-4892d9f7a955 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:55.164020 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1d7dc74d-1317-41ef-bc1b-4892d9f7a955 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:55.164841 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1d7dc74d-1317-41ef-bc1b-4892d9f7a955 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:55.165276 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1d7dc74d-1317-41ef-bc1b-4892d9f7a955 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:55.299671 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5153d1aa-adb2-46de-8d33-02af89ac7bd9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:55.310800 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5153d1aa-adb2-46de-8d33-02af89ac7bd9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:55.310800 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5153d1aa-adb2-46de-8d33-02af89ac7bd9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:55.311265 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5153d1aa-adb2-46de-8d33-02af89ac7bd9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.201594 Feb 21 04:14:55.322001 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 67/137] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:55 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:55.353121 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1d7dc74d-1317-41ef-bc1b-4892d9f7a955 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:55.361153 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1d7dc74d-1317-41ef-bc1b-4892d9f7a955 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.208322 Feb 21 04:14:55.361747 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 71/138] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:55 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:56.123922 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f3c5bdf4-d814-4ac8-b166-65ce396282b9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:56.124575 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f3c5bdf4-d814-4ac8-b166-65ce396282b9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:56.128113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fdd95ec9-04d7-4217-b4c2-5ee5876ff128 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:56.128800 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fdd95ec9-04d7-4217-b4c2-5ee5876ff128 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:56.131570 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f3c5bdf4-d814-4ac8-b166-65ce396282b9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:56.132216 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f3c5bdf4-d814-4ac8-b166-65ce396282b9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:56.133191 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f3c5bdf4-d814-4ac8-b166-65ce396282b9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:56.133671 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f3c5bdf4-d814-4ac8-b166-65ce396282b9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:56.135699 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fdd95ec9-04d7-4217-b4c2-5ee5876ff128 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:56.136952 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fdd95ec9-04d7-4217-b4c2-5ee5876ff128 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:56.138008 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fdd95ec9-04d7-4217-b4c2-5ee5876ff128 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:56.138784 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fdd95ec9-04d7-4217-b4c2-5ee5876ff128 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:56.352195 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-fdd95ec9-04d7-4217-b4c2-5ee5876ff128 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:56.356749 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f3c5bdf4-d814-4ac8-b166-65ce396282b9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:56.364347 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fdd95ec9-04d7-4217-b4c2-5ee5876ff128 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.240985 Feb 21 04:14:56.364903 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f3c5bdf4-d814-4ac8-b166-65ce396282b9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.244820 Feb 21 04:14:56.365474 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 68/139] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:56 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:56.370109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-bff21be3-44b0-464d-a365-53158eceb987 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:56.370762 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-bff21be3-44b0-464d-a365-53158eceb987 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:56.377192 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 72/140] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:56 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:56.377412 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bff21be3-44b0-464d-a365-53158eceb987 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:56.378037 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bff21be3-44b0-464d-a365-53158eceb987 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:56.378937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bff21be3-44b0-464d-a365-53158eceb987 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:56.379380 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bff21be3-44b0-464d-a365-53158eceb987 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:56.386318 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0f184154-35e6-4795-ae28-25eb212f3039 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:56.387350 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0f184154-35e6-4795-ae28-25eb212f3039 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:56.393172 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0f184154-35e6-4795-ae28-25eb212f3039 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:56.393627 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0f184154-35e6-4795-ae28-25eb212f3039 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:56.394419 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0f184154-35e6-4795-ae28-25eb212f3039 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:56.394857 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0f184154-35e6-4795-ae28-25eb212f3039 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:56.591471 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-bff21be3-44b0-464d-a365-53158eceb987 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:56.599086 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0f184154-35e6-4795-ae28-25eb212f3039 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:56.600868 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-bff21be3-44b0-464d-a365-53158eceb987 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:56.602594 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-bff21be3-44b0-464d-a365-53158eceb987 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:56.603771 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-bff21be3-44b0-464d-a365-53158eceb987 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.237190 Feb 21 04:14:56.604932 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 69/141] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:56 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:56.611699 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0f184154-35e6-4795-ae28-25eb212f3039 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.233409 Feb 21 04:14:56.612528 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 73/142] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:56 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:57.392923 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9b5295b4-fc57-484a-8e2c-d215da2bcde8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:57.393553 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9b5295b4-fc57-484a-8e2c-d215da2bcde8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:57.398335 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5f6f421e-ead6-4b26-a990-d7ec37512b4a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:57.398934 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5f6f421e-ead6-4b26-a990-d7ec37512b4a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:57.399420 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9b5295b4-fc57-484a-8e2c-d215da2bcde8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:57.399915 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9b5295b4-fc57-484a-8e2c-d215da2bcde8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:57.400678 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9b5295b4-fc57-484a-8e2c-d215da2bcde8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:57.401168 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9b5295b4-fc57-484a-8e2c-d215da2bcde8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:57.406808 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5f6f421e-ead6-4b26-a990-d7ec37512b4a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:57.407261 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5f6f421e-ead6-4b26-a990-d7ec37512b4a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:57.408044 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5f6f421e-ead6-4b26-a990-d7ec37512b4a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:57.408474 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5f6f421e-ead6-4b26-a990-d7ec37512b4a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:57.605737 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9b5295b4-fc57-484a-8e2c-d215da2bcde8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:57.610837 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5f6f421e-ead6-4b26-a990-d7ec37512b4a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:57.617357 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9b5295b4-fc57-484a-8e2c-d215da2bcde8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.225924 Feb 21 04:14:57.618199 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 70/143] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:57 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:57.622977 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-273c33f7-ac22-40f0-9ad5-5a8d7c9fc29a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:57.623668 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-273c33f7-ac22-40f0-9ad5-5a8d7c9fc29a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:57.625820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5f6f421e-ead6-4b26-a990-d7ec37512b4a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1322 microversion: 2.1 time: 0.230714 Feb 21 04:14:57.630512 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-273c33f7-ac22-40f0-9ad5-5a8d7c9fc29a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:57.631131 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-273c33f7-ac22-40f0-9ad5-5a8d7c9fc29a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:57.632060 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-273c33f7-ac22-40f0-9ad5-5a8d7c9fc29a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:57.632671 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-273c33f7-ac22-40f0-9ad5-5a8d7c9fc29a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:57.636011 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 74/144] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:57 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:57.648898 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1dd7beb8-b716-416f-ba51-e1495fcb3920 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:57.648898 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1dd7beb8-b716-416f-ba51-e1495fcb3920 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:57.648898 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1dd7beb8-b716-416f-ba51-e1495fcb3920 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:57.648898 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1dd7beb8-b716-416f-ba51-e1495fcb3920 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:57.649173 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1dd7beb8-b716-416f-ba51-e1495fcb3920 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:57.649591 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1dd7beb8-b716-416f-ba51-e1495fcb3920 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:57.849445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1dd7beb8-b716-416f-ba51-e1495fcb3920 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:57.853579 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-273c33f7-ac22-40f0-9ad5-5a8d7c9fc29a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:57.856616 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1dd7beb8-b716-416f-ba51-e1495fcb3920 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.219321 Feb 21 04:14:57.857243 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 75/145] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:57 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:14:57.861299 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-273c33f7-ac22-40f0-9ad5-5a8d7c9fc29a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:57.862800 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-273c33f7-ac22-40f0-9ad5-5a8d7c9fc29a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:57.863923 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-273c33f7-ac22-40f0-9ad5-5a8d7c9fc29a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1407 microversion: 2.20 time: 0.244638 Feb 21 04:14:57.864472 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 71/146] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:57 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:58.634382 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b7369a79-a25f-4957-82bb-958c4a96acb8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:58.635107 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b7369a79-a25f-4957-82bb-958c4a96acb8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:58.641301 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b7369a79-a25f-4957-82bb-958c4a96acb8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:58.641927 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b7369a79-a25f-4957-82bb-958c4a96acb8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:58.642717 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b7369a79-a25f-4957-82bb-958c4a96acb8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:58.642823 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-03e031ee-73e3-4cb4-84f1-60759ef3166f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:58.643240 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b7369a79-a25f-4957-82bb-958c4a96acb8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:58.643342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-03e031ee-73e3-4cb4-84f1-60759ef3166f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:58.649633 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03e031ee-73e3-4cb4-84f1-60759ef3166f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:58.650387 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03e031ee-73e3-4cb4-84f1-60759ef3166f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:58.651175 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03e031ee-73e3-4cb4-84f1-60759ef3166f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:58.651609 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03e031ee-73e3-4cb4-84f1-60759ef3166f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:58.843116 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b7369a79-a25f-4957-82bb-958c4a96acb8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:58.845937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-03e031ee-73e3-4cb4-84f1-60759ef3166f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:58.850400 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b7369a79-a25f-4957-82bb-958c4a96acb8 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1315 microversion: 2.1 time: 0.219678 Feb 21 04:14:58.851061 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 76/147] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:58 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:58.853028 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-03e031ee-73e3-4cb4-84f1-60759ef3166f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1516 microversion: 2.1 time: 0.213729 Feb 21 04:14:58.853591 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 72/148] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:58 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1516 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:58.869814 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-19adf4a6-559d-4048-8db0-4254ed710e58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:14:58.870800 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-19adf4a6-559d-4048-8db0-4254ed710e58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:58.871785 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-576e94f6-d136-4966-ae53-6930b5d8a6e6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:58.872388 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-576e94f6-d136-4966-ae53-6930b5d8a6e6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:58.879020 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-576e94f6-d136-4966-ae53-6930b5d8a6e6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:58.879460 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-576e94f6-d136-4966-ae53-6930b5d8a6e6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:58.880227 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-576e94f6-d136-4966-ae53-6930b5d8a6e6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:58.880661 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-576e94f6-d136-4966-ae53-6930b5d8a6e6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:58.884157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-19adf4a6-559d-4048-8db0-4254ed710e58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:58.884612 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-19adf4a6-559d-4048-8db0-4254ed710e58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:58.885440 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-19adf4a6-559d-4048-8db0-4254ed710e58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:58.885883 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-19adf4a6-559d-4048-8db0-4254ed710e58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:58.957386 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-19adf4a6-559d-4048-8db0-4254ed710e58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lazy-loading 'flavor' on Instance uuid 08569093-3abd-43da-8dc2-605b9a289ccf {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:14:59.025493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-576e94f6-d136-4966-ae53-6930b5d8a6e6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:59.035653 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-576e94f6-d136-4966-ae53-6930b5d8a6e6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.167046 Feb 21 04:14:59.036414 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 73/149] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:58 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:59.045198 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9941d13c-8cc5-4ff3-a3db-4e4d6973fcec tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:59.045963 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9941d13c-8cc5-4ff3-a3db-4e4d6973fcec tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:59.052492 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9941d13c-8cc5-4ff3-a3db-4e4d6973fcec tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:59.053037 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9941d13c-8cc5-4ff3-a3db-4e4d6973fcec tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:59.053813 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9941d13c-8cc5-4ff3-a3db-4e4d6973fcec tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:59.054242 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9941d13c-8cc5-4ff3-a3db-4e4d6973fcec tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:59.110557 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-19adf4a6-559d-4048-8db0-4254ed710e58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "POST /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf/action" status: 200 len: 32 microversion: 2.1 time: 0.244020 Feb 21 04:14:59.111339 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 77/150] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:14:58 2022] POST /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf/action => generated 32 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 04:14:59.121205 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-817f42e2-602a-4c57-b9b2-6456f5ca2409 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:59.121910 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-817f42e2-602a-4c57-b9b2-6456f5ca2409 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:59.127912 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-817f42e2-602a-4c57-b9b2-6456f5ca2409 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:59.128367 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-817f42e2-602a-4c57-b9b2-6456f5ca2409 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:59.129186 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-817f42e2-602a-4c57-b9b2-6456f5ca2409 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:59.129625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-817f42e2-602a-4c57-b9b2-6456f5ca2409 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:59.211119 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9941d13c-8cc5-4ff3-a3db-4e4d6973fcec tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:59.219390 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9941d13c-8cc5-4ff3-a3db-4e4d6973fcec tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:59.221097 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9941d13c-8cc5-4ff3-a3db-4e4d6973fcec tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:59.222364 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9941d13c-8cc5-4ff3-a3db-4e4d6973fcec tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1600 microversion: 2.20 time: 0.180938 Feb 21 04:14:59.222930 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 74/151] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:14:59 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:14:59.240247 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9c62ce3c-45a5-47b9-8ecb-c0e4a0f01880 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:59.240888 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9c62ce3c-45a5-47b9-8ecb-c0e4a0f01880 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:59.246547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9c62ce3c-45a5-47b9-8ecb-c0e4a0f01880 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:59.246993 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9c62ce3c-45a5-47b9-8ecb-c0e4a0f01880 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:59.247773 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9c62ce3c-45a5-47b9-8ecb-c0e4a0f01880 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:59.248207 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9c62ce3c-45a5-47b9-8ecb-c0e4a0f01880 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:59.276006 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-817f42e2-602a-4c57-b9b2-6456f5ca2409 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:14:59.283921 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-817f42e2-602a-4c57-b9b2-6456f5ca2409 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.167315 Feb 21 04:14:59.284480 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 78/152] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:59 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:14:59.368294 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9c62ce3c-45a5-47b9-8ecb-c0e4a0f01880 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.131558 Feb 21 04:14:59.368940 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 75/153] 10.222.0.10 () {60 vars in 1315 bytes} [Mon Feb 21 04:14:59 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 04:14:59.866862 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-60002886-62ee-4538-a2e3-e4edaeae043b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:14:59.867678 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-60002886-62ee-4538-a2e3-e4edaeae043b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:14:59.873536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-60002886-62ee-4538-a2e3-e4edaeae043b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:59.873989 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-60002886-62ee-4538-a2e3-e4edaeae043b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:14:59.875295 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-60002886-62ee-4538-a2e3-e4edaeae043b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:14:59.875727 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-60002886-62ee-4538-a2e3-e4edaeae043b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:00.053900 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5b7a2d9f-b414-452a-a2c1-65d701d5e1be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:00.055399 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5b7a2d9f-b414-452a-a2c1-65d701d5e1be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:00.063613 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5b7a2d9f-b414-452a-a2c1-65d701d5e1be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:00.064131 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5b7a2d9f-b414-452a-a2c1-65d701d5e1be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:00.065111 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5b7a2d9f-b414-452a-a2c1-65d701d5e1be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:00.065604 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5b7a2d9f-b414-452a-a2c1-65d701d5e1be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:00.326003 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-60002886-62ee-4538-a2e3-e4edaeae043b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:00.333251 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-60002886-62ee-4538-a2e3-e4edaeae043b tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1502 microversion: 2.1 time: 0.469929 Feb 21 04:15:00.333911 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 79/154] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:14:59 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1502 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:00.338243 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-306f0448-d92a-4223-9fd1-89c7e34ed471 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:00.338914 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-306f0448-d92a-4223-9fd1-89c7e34ed471 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:00.344940 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-306f0448-d92a-4223-9fd1-89c7e34ed471 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:00.345453 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-306f0448-d92a-4223-9fd1-89c7e34ed471 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:00.346581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-306f0448-d92a-4223-9fd1-89c7e34ed471 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:00.347013 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-306f0448-d92a-4223-9fd1-89c7e34ed471 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:00.470592 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5b7a2d9f-b414-452a-a2c1-65d701d5e1be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:00.486262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5b7a2d9f-b414-452a-a2c1-65d701d5e1be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.435990 Feb 21 04:15:00.487447 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 76/155] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:00 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:00.633992 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-306f0448-d92a-4223-9fd1-89c7e34ed471 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:00.644378 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-306f0448-d92a-4223-9fd1-89c7e34ed471 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.309428 Feb 21 04:15:00.645277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 80/156] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:00 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:00.947592 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9251f24e-4c72-414b-b29e-fdec511e4a52 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:00.948119 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9251f24e-4c72-414b-b29e-fdec511e4a52 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:00.950000 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-8eaa17fa-2e44-4048-8783-aa790ce2c182 req-88f68c54-9975-46e6-83ba-503bb3a3d2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c59a20-ff75-456f-99b3-070207d951d7", "tag": "ad4a893e-bbd1-41d8-a92a-483868402b5b"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:15:00.951716 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:15:00.951716 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:15:00.955070 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9251f24e-4c72-414b-b29e-fdec511e4a52 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:00.955533 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9251f24e-4c72-414b-b29e-fdec511e4a52 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:00.956784 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9251f24e-4c72-414b-b29e-fdec511e4a52 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:00.957228 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9251f24e-4c72-414b-b29e-fdec511e4a52 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:00.959725 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-8eaa17fa-2e44-4048-8783-aa790ce2c182 req-88f68c54-9975-46e6-83ba-503bb3a3d2d7 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:00.960246 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-8eaa17fa-2e44-4048-8783-aa790ce2c182 req-88f68c54-9975-46e6-83ba-503bb3a3d2d7 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:00.984748 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9251f24e-4c72-414b-b29e-fdec511e4a52 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/ips" status: 200 len: 113 microversion: 2.20 time: 0.040785 Feb 21 04:15:00.986187 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 77/157] 10.222.0.10 () {60 vars in 1288 bytes} [Mon Feb 21 04:15:00 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/ips => generated 113 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:15:01.114498 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-8eaa17fa-2e44-4048-8783-aa790ce2c182 req-88f68c54-9975-46e6-83ba-503bb3a3d2d7 service nova] Creating event network-changed:ad4a893e-bbd1-41d8-a92a-483868402b5b for instance c0c59a20-ff75-456f-99b3-070207d951d7 on hv-cinder-77398 Feb 21 04:15:01.125334 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-8eaa17fa-2e44-4048-8783-aa790ce2c182 req-88f68c54-9975-46e6-83ba-503bb3a3d2d7 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178345 Feb 21 04:15:01.126562 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 81/158] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:15:01.503562 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b833c265-84bd-4cba-b98f-5bef5b19d812 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:01.504171 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b833c265-84bd-4cba-b98f-5bef5b19d812 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:01.510186 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b833c265-84bd-4cba-b98f-5bef5b19d812 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:01.510736 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b833c265-84bd-4cba-b98f-5bef5b19d812 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:01.511389 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b833c265-84bd-4cba-b98f-5bef5b19d812 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:01.511822 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b833c265-84bd-4cba-b98f-5bef5b19d812 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:01.648698 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b833c265-84bd-4cba-b98f-5bef5b19d812 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:01.656112 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b833c265-84bd-4cba-b98f-5bef5b19d812 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.156607 Feb 21 04:15:01.656896 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 78/159] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:01 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:01.661914 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b212c2de-a3ea-4ea7-8079-20bb4d6aaa61 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:01.664288 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b212c2de-a3ea-4ea7-8079-20bb4d6aaa61 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:01.672302 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b212c2de-a3ea-4ea7-8079-20bb4d6aaa61 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:01.672857 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b212c2de-a3ea-4ea7-8079-20bb4d6aaa61 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:01.673857 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b212c2de-a3ea-4ea7-8079-20bb4d6aaa61 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:01.674365 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b212c2de-a3ea-4ea7-8079-20bb4d6aaa61 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:01.980005 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b212c2de-a3ea-4ea7-8079-20bb4d6aaa61 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:01.988111 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b212c2de-a3ea-4ea7-8079-20bb4d6aaa61 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.330417 Feb 21 04:15:01.988721 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 82/160] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:01 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:15:02.672937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ed41556b-0c6d-4789-a2a2-01946094788a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:02.673534 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ed41556b-0c6d-4789-a2a2-01946094788a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:02.679273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ed41556b-0c6d-4789-a2a2-01946094788a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:02.679717 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ed41556b-0c6d-4789-a2a2-01946094788a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:02.680470 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ed41556b-0c6d-4789-a2a2-01946094788a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:02.680920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ed41556b-0c6d-4789-a2a2-01946094788a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:02.841639 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ed41556b-0c6d-4789-a2a2-01946094788a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:02.849803 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ed41556b-0c6d-4789-a2a2-01946094788a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1317 microversion: 2.1 time: 0.180518 Feb 21 04:15:02.850386 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 79/161] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:02 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:03.006054 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-78d76ed8-24c4-421a-a687-a066b0e1adf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:03.006832 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-78d76ed8-24c4-421a-a687-a066b0e1adf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:03.014917 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78d76ed8-24c4-421a-a687-a066b0e1adf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:03.016059 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78d76ed8-24c4-421a-a687-a066b0e1adf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:03.016980 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78d76ed8-24c4-421a-a687-a066b0e1adf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:03.017509 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78d76ed8-24c4-421a-a687-a066b0e1adf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:03.274780 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-78d76ed8-24c4-421a-a687-a066b0e1adf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:03.282742 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-78d76ed8-24c4-421a-a687-a066b0e1adf3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.281183 Feb 21 04:15:03.283833 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 83/162] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:03 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:03.866127 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-374d2b1c-e5a2-4c8b-871e-9d4688836f8e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:03.866729 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-374d2b1c-e5a2-4c8b-871e-9d4688836f8e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:03.872482 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-374d2b1c-e5a2-4c8b-871e-9d4688836f8e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:03.872953 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-374d2b1c-e5a2-4c8b-871e-9d4688836f8e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:03.873710 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-374d2b1c-e5a2-4c8b-871e-9d4688836f8e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:03.874164 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-374d2b1c-e5a2-4c8b-871e-9d4688836f8e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:04.004761 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-374d2b1c-e5a2-4c8b-871e-9d4688836f8e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:04.012026 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-374d2b1c-e5a2-4c8b-871e-9d4688836f8e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1507 microversion: 2.1 time: 0.149432 Feb 21 04:15:04.012523 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 80/163] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:03 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:04.299000 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ed30708c-b042-4574-8ccd-7edb92bfc46f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:04.299827 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ed30708c-b042-4574-8ccd-7edb92bfc46f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:04.305692 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ed30708c-b042-4574-8ccd-7edb92bfc46f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:04.306104 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ed30708c-b042-4574-8ccd-7edb92bfc46f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:04.306892 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ed30708c-b042-4574-8ccd-7edb92bfc46f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:04.307308 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ed30708c-b042-4574-8ccd-7edb92bfc46f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:04.445581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ed30708c-b042-4574-8ccd-7edb92bfc46f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:04.446200 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ed30708c-b042-4574-8ccd-7edb92bfc46f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.150812 Feb 21 04:15:04.446773 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 84/164] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:04 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:05.464828 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-88e11adc-fe1e-4f9d-8ba4-362d474f9e45 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:05.465520 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-88e11adc-fe1e-4f9d-8ba4-362d474f9e45 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:05.472097 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-88e11adc-fe1e-4f9d-8ba4-362d474f9e45 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:05.472538 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-88e11adc-fe1e-4f9d-8ba4-362d474f9e45 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:05.473342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-88e11adc-fe1e-4f9d-8ba4-362d474f9e45 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:05.473811 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-88e11adc-fe1e-4f9d-8ba4-362d474f9e45 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:05.601048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-88e11adc-fe1e-4f9d-8ba4-362d474f9e45 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:05.608106 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-88e11adc-fe1e-4f9d-8ba4-362d474f9e45 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.146847 Feb 21 04:15:05.608698 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 81/165] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:05 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:06.624812 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-49d27ef6-526c-4635-b171-fbd3914a1cbd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:06.625425 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-49d27ef6-526c-4635-b171-fbd3914a1cbd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:06.631262 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-49d27ef6-526c-4635-b171-fbd3914a1cbd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:06.631715 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-49d27ef6-526c-4635-b171-fbd3914a1cbd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:06.632487 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-49d27ef6-526c-4635-b171-fbd3914a1cbd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:06.632959 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-49d27ef6-526c-4635-b171-fbd3914a1cbd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:06.763573 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-49d27ef6-526c-4635-b171-fbd3914a1cbd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:06.770827 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-49d27ef6-526c-4635-b171-fbd3914a1cbd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.149601 Feb 21 04:15:06.771392 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 85/166] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:06 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:07.787008 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-291375cd-9524-401e-9d03-9c9846b1e13e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:07.787624 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-291375cd-9524-401e-9d03-9c9846b1e13e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:07.793987 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-291375cd-9524-401e-9d03-9c9846b1e13e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:07.794439 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-291375cd-9524-401e-9d03-9c9846b1e13e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:07.795232 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-291375cd-9524-401e-9d03-9c9846b1e13e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:07.795669 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-291375cd-9524-401e-9d03-9c9846b1e13e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:07.924247 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-291375cd-9524-401e-9d03-9c9846b1e13e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:07.931415 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-291375cd-9524-401e-9d03-9c9846b1e13e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.148065 Feb 21 04:15:07.931988 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 82/167] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:07 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:08.948844 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-dcfb8abe-d9b7-49cb-8a07-42c8eeee4d60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:08.949472 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-dcfb8abe-d9b7-49cb-8a07-42c8eeee4d60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:08.956046 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dcfb8abe-d9b7-49cb-8a07-42c8eeee4d60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:08.956490 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dcfb8abe-d9b7-49cb-8a07-42c8eeee4d60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:08.957293 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dcfb8abe-d9b7-49cb-8a07-42c8eeee4d60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:08.957721 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dcfb8abe-d9b7-49cb-8a07-42c8eeee4d60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:09.093057 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dcfb8abe-d9b7-49cb-8a07-42c8eeee4d60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:09.100332 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-dcfb8abe-d9b7-49cb-8a07-42c8eeee4d60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.155891 Feb 21 04:15:09.100926 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 86/168] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:08 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:10.117680 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d3c379f7-2a23-4a58-807a-03ea345552c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:10.118463 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d3c379f7-2a23-4a58-807a-03ea345552c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:10.124219 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d3c379f7-2a23-4a58-807a-03ea345552c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:10.124696 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d3c379f7-2a23-4a58-807a-03ea345552c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:10.125515 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d3c379f7-2a23-4a58-807a-03ea345552c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:10.125947 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d3c379f7-2a23-4a58-807a-03ea345552c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:10.268209 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d3c379f7-2a23-4a58-807a-03ea345552c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:10.275645 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d3c379f7-2a23-4a58-807a-03ea345552c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.161573 Feb 21 04:15:10.276280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 83/169] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:10 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:11.292983 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5dca751f-8628-48fd-9259-856d89aedd3b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:11.293594 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5dca751f-8628-48fd-9259-856d89aedd3b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:11.300097 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5dca751f-8628-48fd-9259-856d89aedd3b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:11.300547 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5dca751f-8628-48fd-9259-856d89aedd3b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:11.301359 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5dca751f-8628-48fd-9259-856d89aedd3b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:11.301790 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5dca751f-8628-48fd-9259-856d89aedd3b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:11.455486 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5dca751f-8628-48fd-9259-856d89aedd3b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:11.462572 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5dca751f-8628-48fd-9259-856d89aedd3b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.173215 Feb 21 04:15:11.463134 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 87/170] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:11 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:12.478755 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5e3f61d0-15cb-4e53-85a8-798d2642febd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:12.479450 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5e3f61d0-15cb-4e53-85a8-798d2642febd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:12.485380 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5e3f61d0-15cb-4e53-85a8-798d2642febd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:12.485899 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5e3f61d0-15cb-4e53-85a8-798d2642febd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:12.486743 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5e3f61d0-15cb-4e53-85a8-798d2642febd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:12.487245 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5e3f61d0-15cb-4e53-85a8-798d2642febd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:12.622502 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5e3f61d0-15cb-4e53-85a8-798d2642febd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:12.629831 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5e3f61d0-15cb-4e53-85a8-798d2642febd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.154613 Feb 21 04:15:12.642150 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 84/171] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:12 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:13.649369 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fd77beee-7f55-4a6b-9ac9-e1bd5ccab72a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:13.650087 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fd77beee-7f55-4a6b-9ac9-e1bd5ccab72a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:13.656038 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fd77beee-7f55-4a6b-9ac9-e1bd5ccab72a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:13.656504 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fd77beee-7f55-4a6b-9ac9-e1bd5ccab72a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:13.657304 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fd77beee-7f55-4a6b-9ac9-e1bd5ccab72a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:13.657742 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fd77beee-7f55-4a6b-9ac9-e1bd5ccab72a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:13.788231 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-fd77beee-7f55-4a6b-9ac9-e1bd5ccab72a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:13.795493 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fd77beee-7f55-4a6b-9ac9-e1bd5ccab72a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.149771 Feb 21 04:15:13.796055 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 88/172] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:13 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:14.812383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7615ca7d-f192-4a29-a13f-1a38479fd5c4 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:14.813018 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7615ca7d-f192-4a29-a13f-1a38479fd5c4 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:14.818777 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7615ca7d-f192-4a29-a13f-1a38479fd5c4 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:14.819224 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7615ca7d-f192-4a29-a13f-1a38479fd5c4 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:14.819991 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7615ca7d-f192-4a29-a13f-1a38479fd5c4 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:14.820425 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7615ca7d-f192-4a29-a13f-1a38479fd5c4 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:14.953914 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7615ca7d-f192-4a29-a13f-1a38479fd5c4 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:14.961041 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7615ca7d-f192-4a29-a13f-1a38479fd5c4 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.152191 Feb 21 04:15:14.961601 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 85/173] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:14 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:15.317240 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f4106974-2206-4f62-b036-852787442f23 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47f1e5be-40a1-4ad8-9ee9-c04292caced4"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:15:15.318808 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f4106974-2206-4f62-b036-852787442f23 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:15.325099 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f4106974-2206-4f62-b036-852787442f23 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:15.325733 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f4106974-2206-4f62-b036-852787442f23 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:15.326509 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f4106974-2206-4f62-b036-852787442f23 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:15.326937 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f4106974-2206-4f62-b036-852787442f23 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:15.631537 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f4106974-2206-4f62-b036-852787442f23 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "POST /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318027 Feb 21 04:15:15.636988 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 89/174] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:15:15 2022] POST /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:15:15.978158 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8717928a-d557-4109-9a52-4f278cb51e49 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:15.978766 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8717928a-d557-4109-9a52-4f278cb51e49 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:15.984500 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8717928a-d557-4109-9a52-4f278cb51e49 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:15.984982 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8717928a-d557-4109-9a52-4f278cb51e49 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:15.985760 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8717928a-d557-4109-9a52-4f278cb51e49 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:15.986195 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8717928a-d557-4109-9a52-4f278cb51e49 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:16.116293 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8717928a-d557-4109-9a52-4f278cb51e49 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:16.123504 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8717928a-d557-4109-9a52-4f278cb51e49 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.149058 Feb 21 04:15:16.124074 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 86/175] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:15 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:16.886007 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f17c6a2f-8fcb-440a-b1a8-a96b4923d39a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8df0147e-dba5-40e5-a9b2-948447ffde45"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:15:16.887197 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f17c6a2f-8fcb-440a-b1a8-a96b4923d39a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:16.894079 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f17c6a2f-8fcb-440a-b1a8-a96b4923d39a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:16.894523 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f17c6a2f-8fcb-440a-b1a8-a96b4923d39a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:16.895288 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f17c6a2f-8fcb-440a-b1a8-a96b4923d39a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:16.895725 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f17c6a2f-8fcb-440a-b1a8-a96b4923d39a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:17.121583 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f17c6a2f-8fcb-440a-b1a8-a96b4923d39a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "POST /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239415 Feb 21 04:15:17.122202 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 90/176] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:15:16 2022] POST /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:15:17.139964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9700bd82-858e-4965-9131-689bab5fb0cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:17.141411 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9700bd82-858e-4965-9131-689bab5fb0cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:17.148029 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9700bd82-858e-4965-9131-689bab5fb0cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:17.148485 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9700bd82-858e-4965-9131-689bab5fb0cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:17.149295 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9700bd82-858e-4965-9131-689bab5fb0cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:17.149731 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9700bd82-858e-4965-9131-689bab5fb0cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:17.281719 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9700bd82-858e-4965-9131-689bab5fb0cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:17.288821 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9700bd82-858e-4965-9131-689bab5fb0cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.152659 Feb 21 04:15:17.289377 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 87/177] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:17 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:18.306662 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8a1012db-8e80-4dbe-ae4b-aa400835257a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:18.307351 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-8a1012db-8e80-4dbe-ae4b-aa400835257a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:18.313417 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8a1012db-8e80-4dbe-ae4b-aa400835257a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:18.313864 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8a1012db-8e80-4dbe-ae4b-aa400835257a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:18.314625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8a1012db-8e80-4dbe-ae4b-aa400835257a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:18.315054 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8a1012db-8e80-4dbe-ae4b-aa400835257a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:18.443992 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8a1012db-8e80-4dbe-ae4b-aa400835257a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:18.451066 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-8a1012db-8e80-4dbe-ae4b-aa400835257a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.148827 Feb 21 04:15:18.451626 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 91/178] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:18 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:15:19.468931 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-dd5f0ba0-ad82-41b9-aa1e-0d99d9d3201f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:19.469537 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-dd5f0ba0-ad82-41b9-aa1e-0d99d9d3201f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:19.475306 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dd5f0ba0-ad82-41b9-aa1e-0d99d9d3201f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:19.475750 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dd5f0ba0-ad82-41b9-aa1e-0d99d9d3201f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:19.476516 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dd5f0ba0-ad82-41b9-aa1e-0d99d9d3201f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:19.476978 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dd5f0ba0-ad82-41b9-aa1e-0d99d9d3201f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:19.604554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-dd5f0ba0-ad82-41b9-aa1e-0d99d9d3201f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:19.611676 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-dd5f0ba0-ad82-41b9-aa1e-0d99d9d3201f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.146910 Feb 21 04:15:19.612260 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 88/179] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:19 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:20.628316 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e6abf278-0e36-4d80-b79c-b651283617d2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:20.628960 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e6abf278-0e36-4d80-b79c-b651283617d2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:20.635948 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e6abf278-0e36-4d80-b79c-b651283617d2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:20.636390 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e6abf278-0e36-4d80-b79c-b651283617d2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:20.637194 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e6abf278-0e36-4d80-b79c-b651283617d2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:20.637624 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e6abf278-0e36-4d80-b79c-b651283617d2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:20.767808 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e6abf278-0e36-4d80-b79c-b651283617d2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:20.775228 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e6abf278-0e36-4d80-b79c-b651283617d2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.150483 Feb 21 04:15:20.775809 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 92/180] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:20 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:21.792391 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c9c096fc-26f1-4ee6-9815-e759dd6bc6bc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:21.793029 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c9c096fc-26f1-4ee6-9815-e759dd6bc6bc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:21.799592 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c9c096fc-26f1-4ee6-9815-e759dd6bc6bc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:21.800037 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c9c096fc-26f1-4ee6-9815-e759dd6bc6bc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:21.800850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c9c096fc-26f1-4ee6-9815-e759dd6bc6bc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:21.801277 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c9c096fc-26f1-4ee6-9815-e759dd6bc6bc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:21.928925 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c9c096fc-26f1-4ee6-9815-e759dd6bc6bc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:21.935911 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c9c096fc-26f1-4ee6-9815-e759dd6bc6bc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.147108 Feb 21 04:15:21.936470 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 89/181] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:21 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:22.952118 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1f0f505a-ffbb-4c29-b2fc-c5c113e3a149 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:22.952771 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1f0f505a-ffbb-4c29-b2fc-c5c113e3a149 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:22.959480 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1f0f505a-ffbb-4c29-b2fc-c5c113e3a149 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:22.959942 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1f0f505a-ffbb-4c29-b2fc-c5c113e3a149 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:22.960851 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1f0f505a-ffbb-4c29-b2fc-c5c113e3a149 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:22.961287 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1f0f505a-ffbb-4c29-b2fc-c5c113e3a149 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:23.097573 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1f0f505a-ffbb-4c29-b2fc-c5c113e3a149 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:23.105296 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1f0f505a-ffbb-4c29-b2fc-c5c113e3a149 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.156187 Feb 21 04:15:23.105910 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 93/182] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:22 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:24.122431 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8b93b846-cef6-4dab-a357-241cc92884a0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:24.123035 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8b93b846-cef6-4dab-a357-241cc92884a0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:24.129433 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8b93b846-cef6-4dab-a357-241cc92884a0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:24.129913 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8b93b846-cef6-4dab-a357-241cc92884a0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:24.130630 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8b93b846-cef6-4dab-a357-241cc92884a0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:24.131115 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8b93b846-cef6-4dab-a357-241cc92884a0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:24.272460 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8b93b846-cef6-4dab-a357-241cc92884a0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:24.280378 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8b93b846-cef6-4dab-a357-241cc92884a0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.161481 Feb 21 04:15:24.281065 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 90/183] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:24 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:25.297508 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-db72f1f5-6225-472e-8939-9aa28c92db39 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:25.298402 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-db72f1f5-6225-472e-8939-9aa28c92db39 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:25.305207 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-db72f1f5-6225-472e-8939-9aa28c92db39 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:25.305999 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-db72f1f5-6225-472e-8939-9aa28c92db39 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:25.307102 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-db72f1f5-6225-472e-8939-9aa28c92db39 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:25.307622 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-db72f1f5-6225-472e-8939-9aa28c92db39 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:25.455448 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-db72f1f5-6225-472e-8939-9aa28c92db39 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:25.463308 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-db72f1f5-6225-472e-8939-9aa28c92db39 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.169450 Feb 21 04:15:25.463900 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 94/184] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:25 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:26.485202 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3a1bf6ae-1c29-4009-afd9-f48a4bb468e8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:26.486387 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3a1bf6ae-1c29-4009-afd9-f48a4bb468e8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:26.493644 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a1bf6ae-1c29-4009-afd9-f48a4bb468e8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:26.494257 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a1bf6ae-1c29-4009-afd9-f48a4bb468e8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:26.495197 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a1bf6ae-1c29-4009-afd9-f48a4bb468e8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:26.495627 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a1bf6ae-1c29-4009-afd9-f48a4bb468e8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:26.641615 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3a1bf6ae-1c29-4009-afd9-f48a4bb468e8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:26.649007 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3a1bf6ae-1c29-4009-afd9-f48a4bb468e8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.169235 Feb 21 04:15:26.649740 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 91/185] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:26 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:27.667319 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-81db3cb1-0443-4e6d-8927-1d0173fed4bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:27.667904 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-81db3cb1-0443-4e6d-8927-1d0173fed4bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:27.674977 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-81db3cb1-0443-4e6d-8927-1d0173fed4bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:27.675418 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-81db3cb1-0443-4e6d-8927-1d0173fed4bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:27.676553 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-81db3cb1-0443-4e6d-8927-1d0173fed4bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:27.677081 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-81db3cb1-0443-4e6d-8927-1d0173fed4bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:27.805410 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-81db3cb1-0443-4e6d-8927-1d0173fed4bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:27.812511 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-81db3cb1-0443-4e6d-8927-1d0173fed4bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.149163 Feb 21 04:15:27.813115 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 95/186] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:27 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:28.829712 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-53d78e17-b73f-4533-b774-86ed929744fc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:28.830312 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-53d78e17-b73f-4533-b774-86ed929744fc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:28.836052 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-53d78e17-b73f-4533-b774-86ed929744fc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:28.836495 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-53d78e17-b73f-4533-b774-86ed929744fc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:28.837296 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-53d78e17-b73f-4533-b774-86ed929744fc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:28.837724 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-53d78e17-b73f-4533-b774-86ed929744fc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:28.968736 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-53d78e17-b73f-4533-b774-86ed929744fc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:28.975895 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-53d78e17-b73f-4533-b774-86ed929744fc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.150377 Feb 21 04:15:28.976460 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 92/187] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:28 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:29.991991 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-29a838ed-8885-4cb6-a6f7-c3156144bf82 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:29.992542 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-29a838ed-8885-4cb6-a6f7-c3156144bf82 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:29.998676 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-29a838ed-8885-4cb6-a6f7-c3156144bf82 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:29.999132 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-29a838ed-8885-4cb6-a6f7-c3156144bf82 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:29.999911 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-29a838ed-8885-4cb6-a6f7-c3156144bf82 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:30.000340 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-29a838ed-8885-4cb6-a6f7-c3156144bf82 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:30.133203 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-29a838ed-8885-4cb6-a6f7-c3156144bf82 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:30.140858 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-29a838ed-8885-4cb6-a6f7-c3156144bf82 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.152572 Feb 21 04:15:30.141416 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 96/188] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:29 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:31.162872 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-86d6905d-ab55-4ca8-b948-a4569865b4c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:31.162872 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-86d6905d-ab55-4ca8-b948-a4569865b4c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:31.165017 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-86d6905d-ab55-4ca8-b948-a4569865b4c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:31.165508 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-86d6905d-ab55-4ca8-b948-a4569865b4c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:31.166328 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-86d6905d-ab55-4ca8-b948-a4569865b4c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:31.166765 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-86d6905d-ab55-4ca8-b948-a4569865b4c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:31.298324 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-86d6905d-ab55-4ca8-b948-a4569865b4c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:31.305388 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-86d6905d-ab55-4ca8-b948-a4569865b4c0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.151311 Feb 21 04:15:31.305951 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 93/189] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:31 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:32.321815 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fdd00f5d-f77a-4227-9517-e14b3b55689e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:32.322431 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fdd00f5d-f77a-4227-9517-e14b3b55689e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:32.328687 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fdd00f5d-f77a-4227-9517-e14b3b55689e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:32.329137 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fdd00f5d-f77a-4227-9517-e14b3b55689e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:32.329915 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fdd00f5d-f77a-4227-9517-e14b3b55689e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:32.330350 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fdd00f5d-f77a-4227-9517-e14b3b55689e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:32.461320 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-fdd00f5d-f77a-4227-9517-e14b3b55689e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:32.468519 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fdd00f5d-f77a-4227-9517-e14b3b55689e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.150285 Feb 21 04:15:32.473029 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 97/190] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:32 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:33.484504 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3f8ce981-c84f-4383-b598-01fe3cdbae60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:33.485135 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3f8ce981-c84f-4383-b598-01fe3cdbae60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:33.491026 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3f8ce981-c84f-4383-b598-01fe3cdbae60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:33.491600 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3f8ce981-c84f-4383-b598-01fe3cdbae60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:33.492474 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3f8ce981-c84f-4383-b598-01fe3cdbae60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:33.493028 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3f8ce981-c84f-4383-b598-01fe3cdbae60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:33.636161 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3f8ce981-c84f-4383-b598-01fe3cdbae60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:33.644085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3f8ce981-c84f-4383-b598-01fe3cdbae60 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.163114 Feb 21 04:15:33.644650 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 94/191] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:33 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:33.799167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3cbca861-9cf4-4487-a2e9-0f96a41987e2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:33.799654 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3cbca861-9cf4-4487-a2e9-0f96a41987e2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:33.806728 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3cbca861-9cf4-4487-a2e9-0f96a41987e2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:33.807302 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3cbca861-9cf4-4487-a2e9-0f96a41987e2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:33.808151 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3cbca861-9cf4-4487-a2e9-0f96a41987e2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:33.808677 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3cbca861-9cf4-4487-a2e9-0f96a41987e2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:33.835017 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3cbca861-9cf4-4487-a2e9-0f96a41987e2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Going to try to terminate instance {{(pid=116571) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:15:33.929334 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3cbca861-9cf4-4487-a2e9-0f96a41987e2 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "DELETE /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 204 len: 0 microversion: 2.1 time: 0.132865 Feb 21 04:15:33.930167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 98/192] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:15:33 2022] DELETE /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:15:33.938596 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fec939e2-3090-4d43-af62-3452f6f89359 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:33.939411 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fec939e2-3090-4d43-af62-3452f6f89359 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:33.945190 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fec939e2-3090-4d43-af62-3452f6f89359 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:33.945645 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fec939e2-3090-4d43-af62-3452f6f89359 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:33.946421 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fec939e2-3090-4d43-af62-3452f6f89359 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:33.947020 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fec939e2-3090-4d43-af62-3452f6f89359 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:34.083253 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fec939e2-3090-4d43-af62-3452f6f89359 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:34.091251 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fec939e2-3090-4d43-af62-3452f6f89359 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1554 microversion: 2.1 time: 0.156904 Feb 21 04:15:34.100827 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 95/193] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:33 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:34.662324 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-801c2738-f0d5-4235-8ec3-e953ba67c530 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:34.663132 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-801c2738-f0d5-4235-8ec3-e953ba67c530 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:34.668817 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-801c2738-f0d5-4235-8ec3-e953ba67c530 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:34.669265 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-801c2738-f0d5-4235-8ec3-e953ba67c530 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:34.670030 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-801c2738-f0d5-4235-8ec3-e953ba67c530 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:34.670454 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-801c2738-f0d5-4235-8ec3-e953ba67c530 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:34.805927 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-801c2738-f0d5-4235-8ec3-e953ba67c530 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:34.813487 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-801c2738-f0d5-4235-8ec3-e953ba67c530 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.155319 Feb 21 04:15:34.814061 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 99/194] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:34 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:35.108074 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-dc5c1962-fccb-470b-aae1-321a4ebf2220 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:35.109239 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-dc5c1962-fccb-470b-aae1-321a4ebf2220 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:35.115474 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc5c1962-fccb-470b-aae1-321a4ebf2220 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:35.115920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc5c1962-fccb-470b-aae1-321a4ebf2220 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:35.116711 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc5c1962-fccb-470b-aae1-321a4ebf2220 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:35.117146 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc5c1962-fccb-470b-aae1-321a4ebf2220 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:35.250947 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-dc5c1962-fccb-470b-aae1-321a4ebf2220 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:35.258649 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-dc5c1962-fccb-470b-aae1-321a4ebf2220 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1554 microversion: 2.1 time: 0.154160 Feb 21 04:15:35.259210 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 96/195] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:35 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:35.829764 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-173cfce4-a1b5-41b0-aced-891d37d11b8a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:35.830489 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-173cfce4-a1b5-41b0-aced-891d37d11b8a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:35.836807 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-173cfce4-a1b5-41b0-aced-891d37d11b8a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:35.837319 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-173cfce4-a1b5-41b0-aced-891d37d11b8a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:35.838157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-173cfce4-a1b5-41b0-aced-891d37d11b8a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:35.838676 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-173cfce4-a1b5-41b0-aced-891d37d11b8a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:35.980308 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-173cfce4-a1b5-41b0-aced-891d37d11b8a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:35.988367 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-173cfce4-a1b5-41b0-aced-891d37d11b8a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.161956 Feb 21 04:15:35.988667 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 100/196] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:35 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:36.276015 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fd44a532-bafc-4ec5-92eb-199b369d5bad tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:36.276750 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fd44a532-bafc-4ec5-92eb-199b369d5bad tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:36.283332 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fd44a532-bafc-4ec5-92eb-199b369d5bad tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:36.283783 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fd44a532-bafc-4ec5-92eb-199b369d5bad tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:36.284554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fd44a532-bafc-4ec5-92eb-199b369d5bad tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:36.285062 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fd44a532-bafc-4ec5-92eb-199b369d5bad tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:36.415098 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fd44a532-bafc-4ec5-92eb-199b369d5bad tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:36.422757 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fd44a532-bafc-4ec5-92eb-199b369d5bad tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1554 microversion: 2.1 time: 0.150283 Feb 21 04:15:36.423327 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 97/197] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:36 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:37.013362 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9c97037f-0c72-4004-a70a-8d00383abe4b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:37.013986 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9c97037f-0c72-4004-a70a-8d00383abe4b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:37.034685 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9c97037f-0c72-4004-a70a-8d00383abe4b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:37.035109 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9c97037f-0c72-4004-a70a-8d00383abe4b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:37.035957 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9c97037f-0c72-4004-a70a-8d00383abe4b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:37.036396 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9c97037f-0c72-4004-a70a-8d00383abe4b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:37.438990 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f1d1c98d-ed2c-4841-887a-bb7502bb046f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:37.440189 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f1d1c98d-ed2c-4841-887a-bb7502bb046f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:37.444512 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9c97037f-0c72-4004-a70a-8d00383abe4b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:37.446354 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f1d1c98d-ed2c-4841-887a-bb7502bb046f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:37.446807 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f1d1c98d-ed2c-4841-887a-bb7502bb046f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:37.447588 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f1d1c98d-ed2c-4841-887a-bb7502bb046f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:37.448405 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f1d1c98d-ed2c-4841-887a-bb7502bb046f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:37.452488 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9c97037f-0c72-4004-a70a-8d00383abe4b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.443881 Feb 21 04:15:37.453214 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 101/198] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:37 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:37.707383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f1d1c98d-ed2c-4841-887a-bb7502bb046f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:37.715581 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f1d1c98d-ed2c-4841-887a-bb7502bb046f tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1554 microversion: 2.1 time: 0.280159 Feb 21 04:15:37.716150 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 98/199] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:37 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1554 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:15:38.468303 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-038de4c7-903f-40e3-b1fc-77dc906f3b97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:38.469697 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-038de4c7-903f-40e3-b1fc-77dc906f3b97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:38.478523 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-038de4c7-903f-40e3-b1fc-77dc906f3b97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:38.479589 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-038de4c7-903f-40e3-b1fc-77dc906f3b97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:38.480443 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-038de4c7-903f-40e3-b1fc-77dc906f3b97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:38.481443 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-038de4c7-903f-40e3-b1fc-77dc906f3b97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:38.733581 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-923e2aeb-2292-40f4-957c-283dc0194066 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:38.734814 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-923e2aeb-2292-40f4-957c-283dc0194066 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:38.743698 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-923e2aeb-2292-40f4-957c-283dc0194066 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:38.744361 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-923e2aeb-2292-40f4-957c-283dc0194066 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:38.745809 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-923e2aeb-2292-40f4-957c-283dc0194066 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:38.746417 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-923e2aeb-2292-40f4-957c-283dc0194066 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:38.945260 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-038de4c7-903f-40e3-b1fc-77dc906f3b97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:38.952566 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-038de4c7-903f-40e3-b1fc-77dc906f3b97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.487959 Feb 21 04:15:38.953210 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 102/200] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:38 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:39.028414 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-923e2aeb-2292-40f4-957c-283dc0194066 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:39.038388 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-923e2aeb-2292-40f4-957c-283dc0194066 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1554 microversion: 2.1 time: 0.308424 Feb 21 04:15:39.040146 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 99/201] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:38 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1554 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:39.975506 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-acc073dc-6e18-4780-bf71-bdfe734049a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:39.976851 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-acc073dc-6e18-4780-bf71-bdfe734049a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:39.984516 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-acc073dc-6e18-4780-bf71-bdfe734049a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:39.985209 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-acc073dc-6e18-4780-bf71-bdfe734049a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:39.985997 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-acc073dc-6e18-4780-bf71-bdfe734049a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:39.986615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-acc073dc-6e18-4780-bf71-bdfe734049a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:40.058076 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fb36b0cc-b03c-4ffe-9466-388132f75714 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:40.059395 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fb36b0cc-b03c-4ffe-9466-388132f75714 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:40.067546 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb36b0cc-b03c-4ffe-9466-388132f75714 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:40.068615 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb36b0cc-b03c-4ffe-9466-388132f75714 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:40.069914 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb36b0cc-b03c-4ffe-9466-388132f75714 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:40.070565 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb36b0cc-b03c-4ffe-9466-388132f75714 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:40.318470 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-acc073dc-6e18-4780-bf71-bdfe734049a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:40.330282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-acc073dc-6e18-4780-bf71-bdfe734049a5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.363338 Feb 21 04:15:40.331309 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 103/202] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:39 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:40.394770 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fb36b0cc-b03c-4ffe-9466-388132f75714 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:40.407887 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fb36b0cc-b03c-4ffe-9466-388132f75714 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1554 microversion: 2.1 time: 0.350403 Feb 21 04:15:40.418533 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 100/203] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:40 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1554 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:41.347184 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b627a820-b0fc-4a17-b8b3-f881ca3d7a22 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:41.348258 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b627a820-b0fc-4a17-b8b3-f881ca3d7a22 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:41.354515 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b627a820-b0fc-4a17-b8b3-f881ca3d7a22 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:41.354996 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b627a820-b0fc-4a17-b8b3-f881ca3d7a22 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:41.355849 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b627a820-b0fc-4a17-b8b3-f881ca3d7a22 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:41.356693 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b627a820-b0fc-4a17-b8b3-f881ca3d7a22 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:41.425758 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fb667173-ed22-499f-b674-89bade8e68aa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:41.426450 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fb667173-ed22-499f-b674-89bade8e68aa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:41.432504 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb667173-ed22-499f-b674-89bade8e68aa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:41.432992 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb667173-ed22-499f-b674-89bade8e68aa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:41.433779 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb667173-ed22-499f-b674-89bade8e68aa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:41.434277 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb667173-ed22-499f-b674-89bade8e68aa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:41.657101 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b627a820-b0fc-4a17-b8b3-f881ca3d7a22 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:41.667454 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b627a820-b0fc-4a17-b8b3-f881ca3d7a22 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.324100 Feb 21 04:15:41.669003 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 104/204] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:41 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:41.743323 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fb667173-ed22-499f-b674-89bade8e68aa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:41.752594 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fb667173-ed22-499f-b674-89bade8e68aa tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1554 microversion: 2.1 time: 0.331427 Feb 21 04:15:41.753225 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 101/205] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:41 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1554 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:15:42.685498 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ca0e88e4-b038-4a99-a4ce-0803b36c83f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:42.686113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ca0e88e4-b038-4a99-a4ce-0803b36c83f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:42.693087 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ca0e88e4-b038-4a99-a4ce-0803b36c83f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:42.693544 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ca0e88e4-b038-4a99-a4ce-0803b36c83f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:42.694322 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ca0e88e4-b038-4a99-a4ce-0803b36c83f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:42.694755 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ca0e88e4-b038-4a99-a4ce-0803b36c83f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:42.778829 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5758d24f-13ae-4c84-8652-984c4edfefbf tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:42.779432 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5758d24f-13ae-4c84-8652-984c4edfefbf tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:42.785810 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5758d24f-13ae-4c84-8652-984c4edfefbf tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:42.786305 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5758d24f-13ae-4c84-8652-984c4edfefbf tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:42.787088 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5758d24f-13ae-4c84-8652-984c4edfefbf tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:42.787519 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5758d24f-13ae-4c84-8652-984c4edfefbf tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:43.037074 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ca0e88e4-b038-4a99-a4ce-0803b36c83f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:43.044459 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ca0e88e4-b038-4a99-a4ce-0803b36c83f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.362594 Feb 21 04:15:43.045237 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 105/206] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:42 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:43.076708 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5758d24f-13ae-4c84-8652-984c4edfefbf tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:43.084539 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5758d24f-13ae-4c84-8652-984c4edfefbf tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1554 microversion: 2.1 time: 0.311772 Feb 21 04:15:43.085426 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 102/207] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:42 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1554 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:44.063384 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3f7cc400-00e7-4575-94af-c02ceddd361a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:44.066883 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3f7cc400-00e7-4575-94af-c02ceddd361a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:44.083402 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3f7cc400-00e7-4575-94af-c02ceddd361a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:44.084974 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3f7cc400-00e7-4575-94af-c02ceddd361a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:44.087058 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3f7cc400-00e7-4575-94af-c02ceddd361a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:44.087751 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3f7cc400-00e7-4575-94af-c02ceddd361a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:44.105623 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d238b53a-e976-4fe7-b0dd-3a11be398670 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:44.106214 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d238b53a-e976-4fe7-b0dd-3a11be398670 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:44.115396 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d238b53a-e976-4fe7-b0dd-3a11be398670 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:44.116085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d238b53a-e976-4fe7-b0dd-3a11be398670 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:44.117256 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d238b53a-e976-4fe7-b0dd-3a11be398670 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:44.118262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d238b53a-e976-4fe7-b0dd-3a11be398670 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:44.583126 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d238b53a-e976-4fe7-b0dd-3a11be398670 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:44.596099 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d238b53a-e976-4fe7-b0dd-3a11be398670 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1554 microversion: 2.1 time: 0.498127 Feb 21 04:15:44.598503 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 103/208] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:44 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1554 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:15:44.634634 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-3f7cc400-00e7-4575-94af-c02ceddd361a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:44.647307 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3f7cc400-00e7-4575-94af-c02ceddd361a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.589297 Feb 21 04:15:44.649893 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 106/209] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:44 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:45.614490 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a4557152-761a-454a-8a15-b07c307b1a18 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:45.615169 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a4557152-761a-454a-8a15-b07c307b1a18 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:45.626850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a4557152-761a-454a-8a15-b07c307b1a18 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:45.627354 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a4557152-761a-454a-8a15-b07c307b1a18 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:45.628225 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a4557152-761a-454a-8a15-b07c307b1a18 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:45.628698 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a4557152-761a-454a-8a15-b07c307b1a18 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:45.666921 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e7e0317f-c1a8-4888-a1de-ad80d06c0ce1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:45.667539 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e7e0317f-c1a8-4888-a1de-ad80d06c0ce1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:45.680275 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e7e0317f-c1a8-4888-a1de-ad80d06c0ce1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:45.684810 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e7e0317f-c1a8-4888-a1de-ad80d06c0ce1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:45.692570 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e7e0317f-c1a8-4888-a1de-ad80d06c0ce1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:45.693790 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e7e0317f-c1a8-4888-a1de-ad80d06c0ce1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:46.258162 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a4557152-761a-454a-8a15-b07c307b1a18 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:46.268291 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a4557152-761a-454a-8a15-b07c307b1a18 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1554 microversion: 2.1 time: 0.657266 Feb 21 04:15:46.269024 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 104/210] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:45 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1554 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:46.281916 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e7e0317f-c1a8-4888-a1de-ad80d06c0ce1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:46.290729 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e7e0317f-c1a8-4888-a1de-ad80d06c0ce1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.627484 Feb 21 04:15:46.291420 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 107/211] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:45 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:47.217763 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-5e5e2bed-2a1a-41a4-8e69-7e5e9d3117b4 req-f84e6149-af00-40e1-b389-e6c29e402b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58885ac-0561-4c6d-bdb4-97e629c9acaa", "name": "network-vif-deleted", "tag": "fc039608-7f10-4b0d-b3ce-2ecd0aa5274d"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:15:47.219901 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:15:47.219901 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:15:47.231580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-5e5e2bed-2a1a-41a4-8e69-7e5e9d3117b4 req-f84e6149-af00-40e1-b389-e6c29e402b4a service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:47.232099 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-5e5e2bed-2a1a-41a4-8e69-7e5e9d3117b4 req-f84e6149-af00-40e1-b389-e6c29e402b4a service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:47.257175 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-5e5e2bed-2a1a-41a4-8e69-7e5e9d3117b4 req-f84e6149-af00-40e1-b389-e6c29e402b4a service nova] Creating event network-vif-deleted:fc039608-7f10-4b0d-b3ce-2ecd0aa5274d for instance d58885ac-0561-4c6d-bdb4-97e629c9acaa on hv-cinder-77398 Feb 21 04:15:47.264597 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-5e5e2bed-2a1a-41a4-8e69-7e5e9d3117b4 req-f84e6149-af00-40e1-b389-e6c29e402b4a service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050619 Feb 21 04:15:47.265620 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 105/212] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:15:47.287300 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6595083d-91d7-4c12-b3f1-d06795fdabde tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:47.287923 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6595083d-91d7-4c12-b3f1-d06795fdabde tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:47.298924 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6595083d-91d7-4c12-b3f1-d06795fdabde tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:47.299372 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6595083d-91d7-4c12-b3f1-d06795fdabde tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:47.300165 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6595083d-91d7-4c12-b3f1-d06795fdabde tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:47.300596 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6595083d-91d7-4c12-b3f1-d06795fdabde tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:47.311073 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-dc1a5354-143c-480c-914d-d3bfb3ec3874 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:47.311921 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-dc1a5354-143c-480c-914d-d3bfb3ec3874 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:47.321298 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc1a5354-143c-480c-914d-d3bfb3ec3874 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:47.321751 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc1a5354-143c-480c-914d-d3bfb3ec3874 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:47.322533 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc1a5354-143c-480c-914d-d3bfb3ec3874 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:47.333174 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc1a5354-143c-480c-914d-d3bfb3ec3874 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:47.449971 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6595083d-91d7-4c12-b3f1-d06795fdabde tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:47.461788 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6595083d-91d7-4c12-b3f1-d06795fdabde tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1346 microversion: 2.1 time: 0.178310 Feb 21 04:15:47.475173 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 108/213] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:47 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1346 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:47.563315 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-dc1a5354-143c-480c-914d-d3bfb3ec3874 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:47.572378 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-dc1a5354-143c-480c-914d-d3bfb3ec3874 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.266108 Feb 21 04:15:47.576735 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 106/214] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:47 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:15:48.491336 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-804b5919-4c09-47d9-b8c0-6edf3a10b42d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:48.493416 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-804b5919-4c09-47d9-b8c0-6edf3a10b42d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:48.508614 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-804b5919-4c09-47d9-b8c0-6edf3a10b42d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:48.517932 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-804b5919-4c09-47d9-b8c0-6edf3a10b42d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:48.521357 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-804b5919-4c09-47d9-b8c0-6edf3a10b42d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:48.524094 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-804b5919-4c09-47d9-b8c0-6edf3a10b42d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:48.595542 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-42544f80-ed92-4356-8af3-8ec13eb9818e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:48.596754 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-42544f80-ed92-4356-8af3-8ec13eb9818e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:48.609600 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-804b5919-4c09-47d9-b8c0-6edf3a10b42d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:48.612475 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-804b5919-4c09-47d9-b8c0-6edf3a10b42d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:48.614282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-804b5919-4c09-47d9-b8c0-6edf3a10b42d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lazy-loading 'fault' on Instance uuid d58885ac-0561-4c6d-bdb4-97e629c9acaa {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:15:48.616167 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-42544f80-ed92-4356-8af3-8ec13eb9818e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:48.616621 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-42544f80-ed92-4356-8af3-8ec13eb9818e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:48.617444 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-42544f80-ed92-4356-8af3-8ec13eb9818e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:48.617947 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-42544f80-ed92-4356-8af3-8ec13eb9818e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:48.700744 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-804b5919-4c09-47d9-b8c0-6edf3a10b42d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3e6f54f19b45ccb7522c5a2bc8a3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d3b51bfa7e4f3190c280abd14571ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:48.713732 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-804b5919-4c09-47d9-b8c0-6edf3a10b42d tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 200 len: 1351 microversion: 2.1 time: 0.225811 Feb 21 04:15:48.726788 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 109/215] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:48 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 1351 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:48.996966 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-42544f80-ed92-4356-8af3-8ec13eb9818e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:49.005031 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-42544f80-ed92-4356-8af3-8ec13eb9818e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1522 microversion: 2.1 time: 0.415684 Feb 21 04:15:49.017828 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 107/216] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:48 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:49.731093 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-880593a9-af72-4b91-a611-6fe002199870 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:49.731696 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-880593a9-af72-4b91-a611-6fe002199870 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:49.749113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-880593a9-af72-4b91-a611-6fe002199870 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:49.751223 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-880593a9-af72-4b91-a611-6fe002199870 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:49.753994 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-880593a9-af72-4b91-a611-6fe002199870 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:49.754671 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-880593a9-af72-4b91-a611-6fe002199870 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:49.780777 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-880593a9-af72-4b91-a611-6fe002199870 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] HTTP exception thrown: Instance d58885ac-0561-4c6d-bdb4-97e629c9acaa could not be found. Feb 21 04:15:49.781770 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-880593a9-af72-4b91-a611-6fe002199870 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Returning 404 to user: Instance d58885ac-0561-4c6d-bdb4-97e629c9acaa could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:15:49.782963 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-880593a9-af72-4b91-a611-6fe002199870 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 404 len: 111 microversion: 2.1 time: 0.055553 Feb 21 04:15:49.788662 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 110/217] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:49 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:15:49.908923 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ddf4db14-4972-4e59-9ffe-fa7cf7f09e03 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:49.910552 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ddf4db14-4972-4e59-9ffe-fa7cf7f09e03 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:49.917511 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ddf4db14-4972-4e59-9ffe-fa7cf7f09e03 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:49.918248 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ddf4db14-4972-4e59-9ffe-fa7cf7f09e03 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:49.919252 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ddf4db14-4972-4e59-9ffe-fa7cf7f09e03 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:49.919896 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ddf4db14-4972-4e59-9ffe-fa7cf7f09e03 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:49.935477 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-ddf4db14-4972-4e59-9ffe-fa7cf7f09e03 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] HTTP exception thrown: Instance d58885ac-0561-4c6d-bdb4-97e629c9acaa could not be found. Feb 21 04:15:49.936347 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ddf4db14-4972-4e59-9ffe-fa7cf7f09e03 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Returning 404 to user: Instance d58885ac-0561-4c6d-bdb4-97e629c9acaa could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:15:49.937578 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ddf4db14-4972-4e59-9ffe-fa7cf7f09e03 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039156 Feb 21 04:15:49.956723 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 108/218] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:15:49 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:15:50.037133 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0915fb25-520a-44b6-a3ba-07c10cb9933d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:50.037771 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0915fb25-520a-44b6-a3ba-07c10cb9933d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:50.046498 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0915fb25-520a-44b6-a3ba-07c10cb9933d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:50.049220 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0915fb25-520a-44b6-a3ba-07c10cb9933d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:50.050458 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0915fb25-520a-44b6-a3ba-07c10cb9933d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:50.052297 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0915fb25-520a-44b6-a3ba-07c10cb9933d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:50.822090 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0915fb25-520a-44b6-a3ba-07c10cb9933d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:50.832130 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0915fb25-520a-44b6-a3ba-07c10cb9933d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1502 microversion: 2.1 time: 0.808573 Feb 21 04:15:50.841700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 111/219] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:50 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1502 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:50.861481 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5cfbaacf-35e4-4013-a425-3cfd5afa8724 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:50.862231 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5cfbaacf-35e4-4013-a425-3cfd5afa8724 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:50.873542 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5cfbaacf-35e4-4013-a425-3cfd5afa8724 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:50.874912 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5cfbaacf-35e4-4013-a425-3cfd5afa8724 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:50.877417 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5cfbaacf-35e4-4013-a425-3cfd5afa8724 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:50.879119 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5cfbaacf-35e4-4013-a425-3cfd5afa8724 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:51.259109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5cfbaacf-35e4-4013-a425-3cfd5afa8724 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:51.263648 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f7ac043d-c51b-4f2d-a063-f69562fb3827 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:51.267672 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5cfbaacf-35e4-4013-a425-3cfd5afa8724 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1515 microversion: 2.1 time: 0.411031 Feb 21 04:15:51.267985 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f7ac043d-c51b-4f2d-a063-f69562fb3827 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:51.270001 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 109/220] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:50 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1515 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:51.281148 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f7ac043d-c51b-4f2d-a063-f69562fb3827 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:51.281919 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f7ac043d-c51b-4f2d-a063-f69562fb3827 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:51.283504 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f7ac043d-c51b-4f2d-a063-f69562fb3827 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:51.284408 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f7ac043d-c51b-4f2d-a063-f69562fb3827 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:51.312270 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-f7ac043d-c51b-4f2d-a063-f69562fb3827 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] HTTP exception thrown: Instance d58885ac-0561-4c6d-bdb4-97e629c9acaa could not be found. Feb 21 04:15:51.313709 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f7ac043d-c51b-4f2d-a063-f69562fb3827 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Returning 404 to user: Instance d58885ac-0561-4c6d-bdb4-97e629c9acaa could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:15:51.315510 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f7ac043d-c51b-4f2d-a063-f69562fb3827 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "DELETE /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 404 len: 111 microversion: 2.1 time: 0.057789 Feb 21 04:15:51.319465 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 112/221] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:15:51 2022] DELETE /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:15:51.325579 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4d2b8501-dc7b-41bc-81ab-2b6abeff97b0 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:51.327604 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4d2b8501-dc7b-41bc-81ab-2b6abeff97b0 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] [instance: d58885ac-0561-4c6d-bdb4-97e629c9acaa] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:51.336130 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4d2b8501-dc7b-41bc-81ab-2b6abeff97b0 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:51.336582 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4d2b8501-dc7b-41bc-81ab-2b6abeff97b0 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:51.341085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4d2b8501-dc7b-41bc-81ab-2b6abeff97b0 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:51.343382 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4d2b8501-dc7b-41bc-81ab-2b6abeff97b0 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:51.370126 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-4d2b8501-dc7b-41bc-81ab-2b6abeff97b0 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] HTTP exception thrown: Instance d58885ac-0561-4c6d-bdb4-97e629c9acaa could not be found. Feb 21 04:15:51.379554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4d2b8501-dc7b-41bc-81ab-2b6abeff97b0 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] Returning 404 to user: Instance d58885ac-0561-4c6d-bdb4-97e629c9acaa could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:15:51.380778 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4d2b8501-dc7b-41bc-81ab-2b6abeff97b0 tempest-DeleteServersTestJSON-1961295482 tempest-DeleteServersTestJSON-1961295482-project] 10.222.0.10 "GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa" status: 404 len: 111 microversion: 2.1 time: 0.059468 Feb 21 04:15:51.384177 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 110/222] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:51 2022] GET /compute/v2.1/servers/d58885ac-0561-4c6d-bdb4-97e629c9acaa => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:15:53.074564 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-47723634-32e1-4dc2-aec0-0b784d660b2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:15:53.075681 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-47723634-32e1-4dc2-aec0-0b784d660b2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:53.083320 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-47723634-32e1-4dc2-aec0-0b784d660b2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:53.083758 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-47723634-32e1-4dc2-aec0-0b784d660b2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:53.084543 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-47723634-32e1-4dc2-aec0-0b784d660b2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:53.085003 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-47723634-32e1-4dc2-aec0-0b784d660b2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:53.139365 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-47723634-32e1-4dc2-aec0-0b784d660b2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lazy-loading 'flavor' on Instance uuid 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:15:53.307115 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-47723634-32e1-4dc2-aec0-0b784d660b2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "POST /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/action" status: 200 len: 32 microversion: 2.1 time: 0.237053 Feb 21 04:15:53.307972 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 113/223] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:15:53 2022] POST /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 04:15:53.317407 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-00b5ffaa-2068-4e15-83b9-f931ce949e51 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:53.318665 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-00b5ffaa-2068-4e15-83b9-f931ce949e51 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:53.331315 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-00b5ffaa-2068-4e15-83b9-f931ce949e51 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:53.332190 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-00b5ffaa-2068-4e15-83b9-f931ce949e51 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:53.333348 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-00b5ffaa-2068-4e15-83b9-f931ce949e51 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:53.337766 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-00b5ffaa-2068-4e15-83b9-f931ce949e51 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:53.861691 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-00b5ffaa-2068-4e15-83b9-f931ce949e51 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:53.871561 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-00b5ffaa-2068-4e15-83b9-f931ce949e51 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.558036 Feb 21 04:15:53.876957 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 111/224] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:53 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:54.185807 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1758418555", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "networks": [{"uuid": "0e926c3e-9f0b-4575-b2e7-0a1f391618f8"}]}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:15:54.275664 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.network.neutron [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] validate_networks() for [('0e926c3e-9f0b-4575-b2e7-0a1f391618f8', None, None, None, None, None)] {{(pid=116571) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:15:54.893771 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-30154105-89be-458f-b298-521e7b57e698 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:54.895081 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-30154105-89be-458f-b298-521e7b57e698 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:54.904992 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-30154105-89be-458f-b298-521e7b57e698 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:54.910484 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-30154105-89be-458f-b298-521e7b57e698 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:54.912782 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-30154105-89be-458f-b298-521e7b57e698 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:54.913845 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-30154105-89be-458f-b298-521e7b57e698 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:55.388624 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-30154105-89be-458f-b298-521e7b57e698 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:55.399528 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Flavor limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:15:55.400860 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Image limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:15:55.401583 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Flavor pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:15:55.402245 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Image pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:15:55.402772 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:15:55.411159 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-30154105-89be-458f-b298-521e7b57e698 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.506999 Feb 21 04:15:55.413351 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 112/225] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:54 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:55.418236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:55.421583 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:55.422699 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:55.423559 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:55.467069 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Getting quotas for project a0b65910b0574d41970df84e6a1fdbba. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:15:55.473201 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Getting quotas for user 0eea911774944fa2bdb292719f9e2a54 and project a0b65910b0574d41970df84e6a1fdbba. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:15:55.509048 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Going to run 1 instances... {{(pid=116571) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:15:55.511120 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:15:55.640060 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3de6a08e-edda-4367-82fe-50344b57f2fc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.460467 Feb 21 04:15:55.641400 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 114/226] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:15:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:15:55.654224 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ce346420-ab90-4d06-b9ac-572397060cdb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:55.654846 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ce346420-ab90-4d06-b9ac-572397060cdb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:55.835041 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ce346420-ab90-4d06-b9ac-572397060cdb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:55.841751 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ce346420-ab90-4d06-b9ac-572397060cdb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1218 microversion: 2.1 time: 0.191683 Feb 21 04:15:55.845885 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 113/227] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:55 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1218 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:56.431267 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-41c5ad4d-0a66-403b-b479-22841cd81ded tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:56.431939 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-41c5ad4d-0a66-403b-b479-22841cd81ded tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:56.453648 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-41c5ad4d-0a66-403b-b479-22841cd81ded tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:56.454768 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-41c5ad4d-0a66-403b-b479-22841cd81ded tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:56.458434 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-41c5ad4d-0a66-403b-b479-22841cd81ded tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:56.458434 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-41c5ad4d-0a66-403b-b479-22841cd81ded tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:56.676305 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-41c5ad4d-0a66-403b-b479-22841cd81ded tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:56.683846 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-41c5ad4d-0a66-403b-b479-22841cd81ded tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.257191 Feb 21 04:15:56.685011 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 115/228] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:56 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:56.861342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5738e550-4c11-4bc2-a8dd-4abfde13e7fb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:56.862745 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5738e550-4c11-4bc2-a8dd-4abfde13e7fb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:56.873582 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5738e550-4c11-4bc2-a8dd-4abfde13e7fb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:56.884367 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5738e550-4c11-4bc2-a8dd-4abfde13e7fb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:56.886448 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5738e550-4c11-4bc2-a8dd-4abfde13e7fb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:56.887303 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5738e550-4c11-4bc2-a8dd-4abfde13e7fb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:57.008783 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5738e550-4c11-4bc2-a8dd-4abfde13e7fb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:57.022273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5738e550-4c11-4bc2-a8dd-4abfde13e7fb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1270 microversion: 2.1 time: 0.166146 Feb 21 04:15:57.034778 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 114/229] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:56 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:57.706695 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0c4cf496-44e0-49ab-bd3f-76894420e8bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:57.707297 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0c4cf496-44e0-49ab-bd3f-76894420e8bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:57.721756 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0c4cf496-44e0-49ab-bd3f-76894420e8bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:57.722214 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0c4cf496-44e0-49ab-bd3f-76894420e8bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:57.723011 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0c4cf496-44e0-49ab-bd3f-76894420e8bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:57.726140 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0c4cf496-44e0-49ab-bd3f-76894420e8bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:58.045496 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e5dcb540-5011-452c-83ac-a359c19344be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:58.047355 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e5dcb540-5011-452c-83ac-a359c19344be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:58.056974 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e5dcb540-5011-452c-83ac-a359c19344be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:58.060456 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e5dcb540-5011-452c-83ac-a359c19344be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:58.061558 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e5dcb540-5011-452c-83ac-a359c19344be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:58.062139 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e5dcb540-5011-452c-83ac-a359c19344be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:58.230602 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e5dcb540-5011-452c-83ac-a359c19344be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:58.240947 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e5dcb540-5011-452c-83ac-a359c19344be tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1276 microversion: 2.1 time: 0.202311 Feb 21 04:15:58.244048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 115/230] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:58 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1276 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:15:58.348529 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0c4cf496-44e0-49ab-bd3f-76894420e8bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:58.369757 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0c4cf496-44e0-49ab-bd3f-76894420e8bd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.666559 Feb 21 04:15:58.392544 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 116/231] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:57 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:15:58.650026 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1486170206", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "networks": [{"uuid": "6ccc7210-5287-4fb4-a169-f1209c8506d4"}]}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:15:58.771817 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.network.neutron [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] validate_networks() for [('6ccc7210-5287-4fb4-a169-f1209c8506d4', None, None, None, None, None)] {{(pid=116570) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:15:59.086140 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-903988be-829c-4c89-b41e-637d29f79f6f tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] Calling method '.version_select at 0x7feee0faba60>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:59.159408 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-903988be-829c-4c89-b41e-637d29f79f6f tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/3f7542a5-05e1-430a-a792-ae8edf5161b3" status: 200 len: 351 microversion: 2.1 time: 0.076759 Feb 21 04:15:59.159982 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 117/232] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:15:59 2022] GET /compute/v2.1/os-volumes/3f7542a5-05e1-430a-a792-ae8edf5161b3 => generated 351 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:15:59.262366 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0e6f3268-8e4e-4f18-9a82-882b063d65c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:59.263763 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0e6f3268-8e4e-4f18-9a82-882b063d65c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:59.275622 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0e6f3268-8e4e-4f18-9a82-882b063d65c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:59.276454 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0e6f3268-8e4e-4f18-9a82-882b063d65c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:59.277807 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0e6f3268-8e4e-4f18-9a82-882b063d65c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:59.278736 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0e6f3268-8e4e-4f18-9a82-882b063d65c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:59.796957 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0e6f3268-8e4e-4f18-9a82-882b063d65c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:15:59.810405 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0e6f3268-8e4e-4f18-9a82-882b063d65c0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.554018 Feb 21 04:15:59.814056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 118/233] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:59 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:15:59.848157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7c93e932-aa6f-422b-8fd1-a67c5da8bfcf tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:15:59.850990 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7c93e932-aa6f-422b-8fd1-a67c5da8bfcf tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:15:59.866216 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Flavor limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:15:59.867202 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Image limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:15:59.867831 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Flavor pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:15:59.868397 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Image pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:15:59.869007 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:15:59.884607 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:59.885249 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:59.887262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:59.890160 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:59.890803 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7c93e932-aa6f-422b-8fd1-a67c5da8bfcf tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:59.891268 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7c93e932-aa6f-422b-8fd1-a67c5da8bfcf tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:59.895965 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7c93e932-aa6f-422b-8fd1-a67c5da8bfcf tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:15:59.896738 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7c93e932-aa6f-422b-8fd1-a67c5da8bfcf tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:15:59.934455 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Getting quotas for project f22350c00f594a80bdd31d6352b095e2. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:15:59.941599 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Getting quotas for user 17fe3cf35ac441e6b17bf8d52298f883 and project f22350c00f594a80bdd31d6352b095e2. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:15:59.957968 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Going to run 1 instances... {{(pid=116570) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:15:59.960289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:16:00.020989 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c6e9a521-060e-4f19-9dc9-57defc978ac4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.374750 Feb 21 04:16:00.021640 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 116/234] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:15:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 04:16:00.032319 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a0e8725a-823e-4f89-87ce-2b44a1dd36d8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:00.033451 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a0e8725a-823e-4f89-87ce-2b44a1dd36d8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:00.164677 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a0e8725a-823e-4f89-87ce-2b44a1dd36d8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:00.176532 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a0e8725a-823e-4f89-87ce-2b44a1dd36d8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1219 microversion: 2.1 time: 0.144529 Feb 21 04:16:00.177239 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 117/235] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:00 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:00.480008 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7c93e932-aa6f-422b-8fd1-a67c5da8bfcf tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:00.518377 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7c93e932-aa6f-422b-8fd1-a67c5da8bfcf tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.701152 Feb 21 04:16:00.519063 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 119/236] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:15:59 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:00.583537 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-10eff97a-6f94-431b-a416-2662d465ac7f req-7d5ecc8d-aab0-474a-884a-e4037aca3043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a128817-df9b-46f1-902b-03d1cbcddb7d", "tag": "ad59d774-1de8-45e3-a9d1-6d9c1aeca36e"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:00.585412 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:16:00.585412 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:16:00.597833 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-10eff97a-6f94-431b-a416-2662d465ac7f req-7d5ecc8d-aab0-474a-884a-e4037aca3043 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:00.600067 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-10eff97a-6f94-431b-a416-2662d465ac7f req-7d5ecc8d-aab0-474a-884a-e4037aca3043 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:00.624828 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-10eff97a-6f94-431b-a416-2662d465ac7f req-7d5ecc8d-aab0-474a-884a-e4037aca3043 service nova] Creating event network-changed:ad59d774-1de8-45e3-a9d1-6d9c1aeca36e for instance 4a128817-df9b-46f1-902b-03d1cbcddb7d on hv-cinder-77398 Feb 21 04:16:00.635553 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-10eff97a-6f94-431b-a416-2662d465ac7f req-7d5ecc8d-aab0-474a-884a-e4037aca3043 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057888 Feb 21 04:16:00.637435 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 118/237] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:16:00.766684 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0b63b42e-a68b-47ba-98e0-c9a699587b11 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] Calling method '.version_select at 0x7feee0f6e430>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:00.831209 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-40b720de-0056-466b-8634-1ec0c15cfcb9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:00.831884 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-40b720de-0056-466b-8634-1ec0c15cfcb9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:00.853461 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-40b720de-0056-466b-8634-1ec0c15cfcb9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:00.853913 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-40b720de-0056-466b-8634-1ec0c15cfcb9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:00.855163 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-40b720de-0056-466b-8634-1ec0c15cfcb9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:00.855163 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-40b720de-0056-466b-8634-1ec0c15cfcb9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:00.884599 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0b63b42e-a68b-47ba-98e0-c9a699587b11 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/46ae3d2e-be1f-424f-81e8-4d90eb2d529e" status: 200 len: 351 microversion: 2.1 time: 0.126487 Feb 21 04:16:00.885581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 120/238] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:16:00 2022] GET /compute/v2.1/os-volumes/46ae3d2e-be1f-424f-81e8-4d90eb2d529e => generated 351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:16:01.071089 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-40b720de-0056-466b-8634-1ec0c15cfcb9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:01.087982 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-40b720de-0056-466b-8634-1ec0c15cfcb9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.261739 Feb 21 04:16:01.089602 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 119/239] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:00 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:01.193542 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a1fcc48f-8b64-4c62-90ff-6957292b2bfd tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:01.194150 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a1fcc48f-8b64-4c62-90ff-6957292b2bfd tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:01.205606 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a1fcc48f-8b64-4c62-90ff-6957292b2bfd tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:01.206070 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a1fcc48f-8b64-4c62-90ff-6957292b2bfd tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:01.208227 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a1fcc48f-8b64-4c62-90ff-6957292b2bfd tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:01.208786 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a1fcc48f-8b64-4c62-90ff-6957292b2bfd tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:01.288684 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a1fcc48f-8b64-4c62-90ff-6957292b2bfd tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:01.297379 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a1fcc48f-8b64-4c62-90ff-6957292b2bfd tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1223 microversion: 2.1 time: 0.107811 Feb 21 04:16:01.310827 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 121/240] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:01 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:01.535817 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8168a83b-4df2-45cf-bc29-7aad15192c23 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:01.536475 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8168a83b-4df2-45cf-bc29-7aad15192c23 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:01.542994 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8168a83b-4df2-45cf-bc29-7aad15192c23 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:01.543620 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8168a83b-4df2-45cf-bc29-7aad15192c23 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:01.544789 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8168a83b-4df2-45cf-bc29-7aad15192c23 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:01.545120 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8168a83b-4df2-45cf-bc29-7aad15192c23 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:01.738769 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8168a83b-4df2-45cf-bc29-7aad15192c23 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:01.754494 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8168a83b-4df2-45cf-bc29-7aad15192c23 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.222557 Feb 21 04:16:01.755078 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 120/241] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:01 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:02.106782 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-85b3a38d-c629-4199-b576-be54f606d9d4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:02.108160 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-85b3a38d-c629-4199-b576-be54f606d9d4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:02.113196 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-85b3a38d-c629-4199-b576-be54f606d9d4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:02.113642 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-85b3a38d-c629-4199-b576-be54f606d9d4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:02.114429 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-85b3a38d-c629-4199-b576-be54f606d9d4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:02.114864 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-85b3a38d-c629-4199-b576-be54f606d9d4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:02.267146 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-85b3a38d-c629-4199-b576-be54f606d9d4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:02.277366 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-85b3a38d-c629-4199-b576-be54f606d9d4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.175026 Feb 21 04:16:02.278196 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 122/242] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:02 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:02.314443 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1e7b5143-6763-431a-b0e6-cbe21c6db905 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:02.315667 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1e7b5143-6763-431a-b0e6-cbe21c6db905 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:02.324540 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1e7b5143-6763-431a-b0e6-cbe21c6db905 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:02.325290 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1e7b5143-6763-431a-b0e6-cbe21c6db905 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:02.326259 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1e7b5143-6763-431a-b0e6-cbe21c6db905 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:02.326720 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1e7b5143-6763-431a-b0e6-cbe21c6db905 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:02.398451 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1e7b5143-6763-431a-b0e6-cbe21c6db905 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:02.406207 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1e7b5143-6763-431a-b0e6-cbe21c6db905 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1223 microversion: 2.1 time: 0.095989 Feb 21 04:16:02.407070 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 121/243] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:02 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:02.773487 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1e70d426-3295-40ad-9d39-7c99aedd90af tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:02.774427 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1e70d426-3295-40ad-9d39-7c99aedd90af tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:02.781813 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1e70d426-3295-40ad-9d39-7c99aedd90af tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:02.782482 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1e70d426-3295-40ad-9d39-7c99aedd90af tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:02.783455 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1e70d426-3295-40ad-9d39-7c99aedd90af tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:02.783882 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1e70d426-3295-40ad-9d39-7c99aedd90af tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:02.931846 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1e70d426-3295-40ad-9d39-7c99aedd90af tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:02.941985 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1e70d426-3295-40ad-9d39-7c99aedd90af tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.172066 Feb 21 04:16:02.944672 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 123/244] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:02 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:03.293445 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6f7bcc67-75f9-4346-a3ae-b024e01ac06e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:03.294303 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6f7bcc67-75f9-4346-a3ae-b024e01ac06e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:03.300972 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6f7bcc67-75f9-4346-a3ae-b024e01ac06e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:03.301420 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6f7bcc67-75f9-4346-a3ae-b024e01ac06e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:03.302209 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6f7bcc67-75f9-4346-a3ae-b024e01ac06e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:03.302640 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6f7bcc67-75f9-4346-a3ae-b024e01ac06e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:03.422796 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e50f059f-f58a-4f8f-ad18-e9b83b2a306b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:03.423408 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e50f059f-f58a-4f8f-ad18-e9b83b2a306b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:03.433830 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e50f059f-f58a-4f8f-ad18-e9b83b2a306b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:03.434278 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e50f059f-f58a-4f8f-ad18-e9b83b2a306b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:03.435077 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e50f059f-f58a-4f8f-ad18-e9b83b2a306b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:03.435504 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e50f059f-f58a-4f8f-ad18-e9b83b2a306b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:03.490166 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6f7bcc67-75f9-4346-a3ae-b024e01ac06e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:03.499534 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6f7bcc67-75f9-4346-a3ae-b024e01ac06e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.209145 Feb 21 04:16:03.500284 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 122/245] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:03 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:03.507137 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e50f059f-f58a-4f8f-ad18-e9b83b2a306b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:03.516590 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e50f059f-f58a-4f8f-ad18-e9b83b2a306b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1215 microversion: 2.1 time: 0.097011 Feb 21 04:16:03.517946 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 124/246] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:03 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:03.958118 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9b57402f-47d7-4ca0-8d74-5f95f2c4bc9b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:03.958733 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9b57402f-47d7-4ca0-8d74-5f95f2c4bc9b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:03.965480 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9b57402f-47d7-4ca0-8d74-5f95f2c4bc9b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:03.966227 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9b57402f-47d7-4ca0-8d74-5f95f2c4bc9b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:03.967167 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9b57402f-47d7-4ca0-8d74-5f95f2c4bc9b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:03.967777 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9b57402f-47d7-4ca0-8d74-5f95f2c4bc9b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:04.116704 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9b57402f-47d7-4ca0-8d74-5f95f2c4bc9b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:04.125049 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9b57402f-47d7-4ca0-8d74-5f95f2c4bc9b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.170419 Feb 21 04:16:04.125635 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 123/247] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:03 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:04.265368 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a54931bd-4724-48fd-a0a6-3936db8a1890 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Action: 'create', calling method: .version_select at 0x7feee195e4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2043381222"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:04.280289 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-a54931bd-4724-48fd-a0a6-3936db8a1890 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Getting quotas for project aa514a3d1a314decab32eefda5e67939. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:16:04.284107 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-a54931bd-4724-48fd-a0a6-3936db8a1890 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Getting quotas for user c146467155e643e3ac31a6f8976b1efc and project aa514a3d1a314decab32eefda5e67939. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:16:04.516811 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-67955e4e-22cb-47ec-adcf-37ba488e1f22 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:04.517434 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-67955e4e-22cb-47ec-adcf-37ba488e1f22 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:04.523314 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-67955e4e-22cb-47ec-adcf-37ba488e1f22 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:04.523758 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-67955e4e-22cb-47ec-adcf-37ba488e1f22 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:04.524540 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-67955e4e-22cb-47ec-adcf-37ba488e1f22 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:04.525069 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-67955e4e-22cb-47ec-adcf-37ba488e1f22 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:04.542928 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-a54931bd-4724-48fd-a0a6-3936db8a1890 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Getting quotas for project aa514a3d1a314decab32eefda5e67939. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:16:04.547316 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-a54931bd-4724-48fd-a0a6-3936db8a1890 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Getting quotas for user c146467155e643e3ac31a6f8976b1efc and project aa514a3d1a314decab32eefda5e67939. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:16:04.563957 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a54931bd-4724-48fd-a0a6-3936db8a1890 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.302595 Feb 21 04:16:04.564570 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 125/248] 10.222.0.10 () {60 vars in 1157 bytes} [Mon Feb 21 04:16:04 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:04.569811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9e7338de-7b84-4714-8d63-e0b5d46128e7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:04.570676 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9e7338de-7b84-4714-8d63-e0b5d46128e7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:04.576794 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e7338de-7b84-4714-8d63-e0b5d46128e7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:04.577561 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e7338de-7b84-4714-8d63-e0b5d46128e7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:04.578038 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e7338de-7b84-4714-8d63-e0b5d46128e7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:04.578452 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e7338de-7b84-4714-8d63-e0b5d46128e7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:04.650445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9e7338de-7b84-4714-8d63-e0b5d46128e7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:04.658016 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9e7338de-7b84-4714-8d63-e0b5d46128e7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1271 microversion: 2.1 time: 0.091705 Feb 21 04:16:04.658586 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 126/249] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:04 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:04.663813 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2067321413", "imageRef": "18825989-f3e6-4f39-a9e8-3886081aa0c7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2043381222", "networks": [{"uuid": "1757e5fc-c4b3-4899-835a-555e305edb49"}]}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:04.696360 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-67955e4e-22cb-47ec-adcf-37ba488e1f22 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:04.703554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-67955e4e-22cb-47ec-adcf-37ba488e1f22 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.190936 Feb 21 04:16:04.704124 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 124/250] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:04 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:04.721503 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.network.neutron [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] validate_networks() for [('1757e5fc-c4b3-4899-835a-555e305edb49', None, None, None, None, None)] {{(pid=116571) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:16:05.142261 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e6051258-81ca-4e88-84cb-4077f4f4848b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:05.143037 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e6051258-81ca-4e88-84cb-4077f4f4848b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:05.149319 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6051258-81ca-4e88-84cb-4077f4f4848b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:05.149926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6051258-81ca-4e88-84cb-4077f4f4848b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:05.150802 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6051258-81ca-4e88-84cb-4077f4f4848b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:05.151338 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6051258-81ca-4e88-84cb-4077f4f4848b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:05.425493 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Flavor limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:16:05.426022 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Image limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:16:05.426604 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Flavor pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:16:05.427113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Image pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:16:05.427626 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:16:05.438807 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:05.442999 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:05.444090 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:05.445182 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:05.479584 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Getting quotas for project aa514a3d1a314decab32eefda5e67939. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:16:05.490290 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Getting quotas for user c146467155e643e3ac31a6f8976b1efc and project aa514a3d1a314decab32eefda5e67939. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:16:05.511093 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Going to run 1 instances... {{(pid=116571) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:16:05.513352 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='18825989-f3e6-4f39-a9e8-3886081aa0c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:16:05.568661 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-73f89e39-22a7-473a-952b-cbc1d877442f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908092 Feb 21 04:16:05.570062 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 127/251] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:16:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 04:16:05.578425 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-98fcb449-0ecd-405c-b45e-87fd7ce86515 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] Calling method '.version_select at 0x7feee0f99ca0>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:05.604571 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e6051258-81ca-4e88-84cb-4077f4f4848b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:05.624049 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e6051258-81ca-4e88-84cb-4077f4f4848b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.485329 Feb 21 04:16:05.624660 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 125/252] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:05 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:05.639908 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9c092c7d-6c4a-4d9c-9f1f-201be2f0098d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:05.640512 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9c092c7d-6c4a-4d9c-9f1f-201be2f0098d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:05.673554 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-98fcb449-0ecd-405c-b45e-87fd7ce86515 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/5f148d7d-d7a3-4b10-916c-818fc24f29f5" status: 200 len: 350 microversion: 2.1 time: 0.099638 Feb 21 04:16:05.674227 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 128/253] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:16:05 2022] GET /compute/v2.1/os-volumes/5f148d7d-d7a3-4b10-916c-818fc24f29f5 => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:16:05.682221 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-60eb7d53-c329-434d-b91a-e613d9cba602 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:05.683176 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-60eb7d53-c329-434d-b91a-e613d9cba602 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:05.691020 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-60eb7d53-c329-434d-b91a-e613d9cba602 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:05.691594 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-60eb7d53-c329-434d-b91a-e613d9cba602 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:05.692479 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-60eb7d53-c329-434d-b91a-e613d9cba602 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:05.693068 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-60eb7d53-c329-434d-b91a-e613d9cba602 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:05.714471 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9c092c7d-6c4a-4d9c-9f1f-201be2f0098d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:05.724543 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9c092c7d-6c4a-4d9c-9f1f-201be2f0098d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1259 microversion: 2.1 time: 0.088612 Feb 21 04:16:05.728677 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 126/254] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:05 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1259 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:05.729383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-cc8025a6-37c0-42b3-aac7-51a402785347 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] Calling method '.version_select at 0x7feee19203a0>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:05.779131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-60eb7d53-c329-434d-b91a-e613d9cba602 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:05.793098 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-60eb7d53-c329-434d-b91a-e613d9cba602 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1277 microversion: 2.1 time: 0.115153 Feb 21 04:16:05.797410 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 129/255] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:05 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:05.804011 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b408219a-5e8d-437f-96e3-ff2f2372cee1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:05.805006 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b408219a-5e8d-437f-96e3-ff2f2372cee1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:05.825692 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b408219a-5e8d-437f-96e3-ff2f2372cee1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:05.826437 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b408219a-5e8d-437f-96e3-ff2f2372cee1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:05.827808 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b408219a-5e8d-437f-96e3-ff2f2372cee1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:05.834615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b408219a-5e8d-437f-96e3-ff2f2372cee1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:05.854055 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-cc8025a6-37c0-42b3-aac7-51a402785347 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] 10.222.0.10 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.127791 Feb 21 04:16:05.855178 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 127/256] 10.222.0.10 () {58 vars in 1133 bytes} [Mon Feb 21 04:16:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:05.867922 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-43954e44-ed36-4eff-bbf5-1b17a8f6caee tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] Calling method '.version_select at 0x7feee181c820>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:05.994197 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-43954e44-ed36-4eff-bbf5-1b17a8f6caee tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] 10.222.0.10 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.130663 Feb 21 04:16:06.005096 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 128/257] 10.222.0.10 () {58 vars in 1148 bytes} [Mon Feb 21 04:16:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:16:06.010773 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fc7d53e6-b244-45bf-bf73-3cc4624c45e9 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] Calling method '.version_select at 0x7feee17d30d0>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:06.012649 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b408219a-5e8d-437f-96e3-ff2f2372cee1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:06.021644 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b408219a-5e8d-437f-96e3-ff2f2372cee1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.222542 Feb 21 04:16:06.022225 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 130/258] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:05 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:06.093848 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fc7d53e6-b244-45bf-bf73-3cc4624c45e9 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] 10.222.0.10 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087050 Feb 21 04:16:06.094889 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 129/259] 10.222.0.10 () {58 vars in 1133 bytes} [Mon Feb 21 04:16:06 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:06.105617 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3fb230d4-b8d3-40aa-9d2c-46cfbf8adf6f tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] Calling method '.version_select at 0x7feee0fa1790>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:06.190271 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3fb230d4-b8d3-40aa-9d2c-46cfbf8adf6f tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] 10.222.0.10 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088197 Feb 21 04:16:06.190833 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 131/260] 10.222.0.10 () {58 vars in 1166 bytes} [Mon Feb 21 04:16:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:16:06.203323 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-991920b1-a47c-4a8e-8152-4578ff520423 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] Calling method '.version_select at 0x7feee17d3f70>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:06.294661 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-991920b1-a47c-4a8e-8152-4578ff520423 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094888 Feb 21 04:16:06.296298 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 130/261] 10.222.0.10 () {58 vars in 1169 bytes} [Mon Feb 21 04:16:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:16:06.308472 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3950c34e-fa91-4e51-9d13-9a8081c9cfb1 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] Calling method '.version_select at 0x7feee0f998b0>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:06.397401 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3950c34e-fa91-4e51-9d13-9a8081c9cfb1 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092361 Feb 21 04:16:06.398050 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 132/262] 10.222.0.10 () {58 vars in 1154 bytes} [Mon Feb 21 04:16:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:06.409834 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-bb1f0e32-87f0-4b75-b935-26a1d9aa4be9 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] Calling method '.version_select at 0x7feee17d3e50>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:06.489999 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-bb1f0e32-87f0-4b75-b935-26a1d9aa4be9 tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083883 Feb 21 04:16:06.490561 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 131/263] 10.222.0.10 () {58 vars in 1187 bytes} [Mon Feb 21 04:16:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:16:06.501549 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9b3b91e8-1da9-44fb-bf8e-6dc914f56cdd tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] Calling method '.version_select at 0x7feee0fb2c10>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:06.582634 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9b3b91e8-1da9-44fb-bf8e-6dc914f56cdd tempest-VolumesTestJSON-1427909327 tempest-VolumesTestJSON-1427909327-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084370 Feb 21 04:16:06.584283 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 133/264] 10.222.0.10 () {58 vars in 1154 bytes} [Mon Feb 21 04:16:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:06.640794 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c59482d5-e79a-4b8a-ae3a-fdebc6a075c8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:06.641493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c59482d5-e79a-4b8a-ae3a-fdebc6a075c8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:06.648492 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c59482d5-e79a-4b8a-ae3a-fdebc6a075c8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:06.649194 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c59482d5-e79a-4b8a-ae3a-fdebc6a075c8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:06.651117 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c59482d5-e79a-4b8a-ae3a-fdebc6a075c8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:06.651770 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c59482d5-e79a-4b8a-ae3a-fdebc6a075c8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:06.752611 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-62943548-1f21-4d1a-b107-95794f912928 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:06.753368 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-62943548-1f21-4d1a-b107-95794f912928 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:06.761622 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-62943548-1f21-4d1a-b107-95794f912928 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:06.776363 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-62943548-1f21-4d1a-b107-95794f912928 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:06.777761 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-62943548-1f21-4d1a-b107-95794f912928 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:06.779151 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-62943548-1f21-4d1a-b107-95794f912928 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:06.807650 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c59482d5-e79a-4b8a-ae3a-fdebc6a075c8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:06.818412 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c59482d5-e79a-4b8a-ae3a-fdebc6a075c8 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.180402 Feb 21 04:16:06.819546 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 132/265] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:06 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:06.828180 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-15090b61-70f8-4248-8d2c-bf15ad944b9b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:06.829128 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-15090b61-70f8-4248-8d2c-bf15ad944b9b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:06.836330 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-15090b61-70f8-4248-8d2c-bf15ad944b9b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:06.836787 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-15090b61-70f8-4248-8d2c-bf15ad944b9b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:06.837745 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-15090b61-70f8-4248-8d2c-bf15ad944b9b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:06.838911 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-15090b61-70f8-4248-8d2c-bf15ad944b9b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:06.864178 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-62943548-1f21-4d1a-b107-95794f912928 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:06.876711 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-62943548-1f21-4d1a-b107-95794f912928 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1311 microversion: 2.1 time: 0.138392 Feb 21 04:16:06.877704 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 134/266] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:06 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:07.002723 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-5d516567-84e8-441b-b604-314e3fc22dd1 req-382e0a9f-fcd5-4661-9f6a-ee31f6d6c4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4bf519a-d7d3-4837-9967-170c581923b9", "tag": "e3b4314c-490f-4b92-b46a-0ebe1ed983f0"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:07.007884 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:16:07.007884 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:16:07.018294 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-5d516567-84e8-441b-b604-314e3fc22dd1 req-382e0a9f-fcd5-4661-9f6a-ee31f6d6c4e9 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:07.019072 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-5d516567-84e8-441b-b604-314e3fc22dd1 req-382e0a9f-fcd5-4661-9f6a-ee31f6d6c4e9 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:07.037843 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-5d516567-84e8-441b-b604-314e3fc22dd1 req-382e0a9f-fcd5-4661-9f6a-ee31f6d6c4e9 service nova] Creating event network-changed:e3b4314c-490f-4b92-b46a-0ebe1ed983f0 for instance c4bf519a-d7d3-4837-9967-170c581923b9 on hv-cinder-77398 Feb 21 04:16:07.043631 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-5d516567-84e8-441b-b604-314e3fc22dd1 req-382e0a9f-fcd5-4661-9f6a-ee31f6d6c4e9 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047522 Feb 21 04:16:07.045079 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 135/267] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:16:07.053336 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-32feaba8-22bc-4c50-b963-c24825ef8eb3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:07.054407 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-32feaba8-22bc-4c50-b963-c24825ef8eb3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:07.062480 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-32feaba8-22bc-4c50-b963-c24825ef8eb3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:07.063921 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-32feaba8-22bc-4c50-b963-c24825ef8eb3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:07.065329 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-32feaba8-22bc-4c50-b963-c24825ef8eb3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:07.066069 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-32feaba8-22bc-4c50-b963-c24825ef8eb3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:07.112972 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-15090b61-70f8-4248-8d2c-bf15ad944b9b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:07.130522 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-15090b61-70f8-4248-8d2c-bf15ad944b9b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.305568 Feb 21 04:16:07.131108 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 133/268] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:06 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:07.560812 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-32feaba8-22bc-4c50-b963-c24825ef8eb3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:07.572350 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-32feaba8-22bc-4c50-b963-c24825ef8eb3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.521505 Feb 21 04:16:07.573227 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 136/269] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:07 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:07.837083 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-99e3f1da-f995-4813-9b96-571c232fe65f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:07.837964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-99e3f1da-f995-4813-9b96-571c232fe65f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:07.853386 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-99e3f1da-f995-4813-9b96-571c232fe65f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:07.855050 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-99e3f1da-f995-4813-9b96-571c232fe65f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:07.864014 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-99e3f1da-f995-4813-9b96-571c232fe65f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:07.865251 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-99e3f1da-f995-4813-9b96-571c232fe65f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:07.896617 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7fd77d5f-17eb-42ff-9ded-db51935ef5fa tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:07.899206 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7fd77d5f-17eb-42ff-9ded-db51935ef5fa tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:07.925606 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7fd77d5f-17eb-42ff-9ded-db51935ef5fa tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:07.927725 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7fd77d5f-17eb-42ff-9ded-db51935ef5fa tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:07.929295 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7fd77d5f-17eb-42ff-9ded-db51935ef5fa tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:07.932267 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7fd77d5f-17eb-42ff-9ded-db51935ef5fa tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:08.107490 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7fd77d5f-17eb-42ff-9ded-db51935ef5fa tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:08.127847 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7fd77d5f-17eb-42ff-9ded-db51935ef5fa tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1317 microversion: 2.1 time: 0.235732 Feb 21 04:16:08.142049 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 137/270] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:07 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:08.149853 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f82841d5-9ca4-4387-9ea2-fd116372a57f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:08.155104 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f82841d5-9ca4-4387-9ea2-fd116372a57f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:08.166226 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f82841d5-9ca4-4387-9ea2-fd116372a57f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:08.168181 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f82841d5-9ca4-4387-9ea2-fd116372a57f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:08.169433 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f82841d5-9ca4-4387-9ea2-fd116372a57f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:08.173287 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f82841d5-9ca4-4387-9ea2-fd116372a57f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:08.491884 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-99e3f1da-f995-4813-9b96-571c232fe65f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:08.502163 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-99e3f1da-f995-4813-9b96-571c232fe65f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.670434 Feb 21 04:16:08.503458 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 134/271] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:07 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:08.523181 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-f82841d5-9ca4-4387-9ea2-fd116372a57f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:08.532526 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f82841d5-9ca4-4387-9ea2-fd116372a57f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.388719 Feb 21 04:16:08.546183 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 138/272] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:08 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:08.596476 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-35846888-b81b-4b2c-a665-75ca626b608e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:08.597408 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-35846888-b81b-4b2c-a665-75ca626b608e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:08.611655 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35846888-b81b-4b2c-a665-75ca626b608e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:08.612199 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35846888-b81b-4b2c-a665-75ca626b608e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:08.614900 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35846888-b81b-4b2c-a665-75ca626b608e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:08.616936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35846888-b81b-4b2c-a665-75ca626b608e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:09.041554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-35846888-b81b-4b2c-a665-75ca626b608e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:09.069941 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-35846888-b81b-4b2c-a665-75ca626b608e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.465028 Feb 21 04:16:09.069941 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 135/273] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:08 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:09.155745 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-eb254b69-d29f-431f-91b8-4a80853555db tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:09.156481 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-eb254b69-d29f-431f-91b8-4a80853555db tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:09.165537 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eb254b69-d29f-431f-91b8-4a80853555db tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:09.166472 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eb254b69-d29f-431f-91b8-4a80853555db tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:09.167515 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eb254b69-d29f-431f-91b8-4a80853555db tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:09.168238 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eb254b69-d29f-431f-91b8-4a80853555db tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:09.491457 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-eb254b69-d29f-431f-91b8-4a80853555db tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:09.504390 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-eb254b69-d29f-431f-91b8-4a80853555db tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.356494 Feb 21 04:16:09.505706 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 139/274] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:09 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:09.520338 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8e821c72-c2ef-4229-a35f-f634cfebee5d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:09.521265 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8e821c72-c2ef-4229-a35f-f634cfebee5d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:09.532789 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8e821c72-c2ef-4229-a35f-f634cfebee5d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:09.533461 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8e821c72-c2ef-4229-a35f-f634cfebee5d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:09.534488 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8e821c72-c2ef-4229-a35f-f634cfebee5d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:09.535098 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8e821c72-c2ef-4229-a35f-f634cfebee5d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:09.554255 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c48fd64d-008f-4376-81e8-ccb03203e9b7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:09.554968 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c48fd64d-008f-4376-81e8-ccb03203e9b7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:09.566726 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c48fd64d-008f-4376-81e8-ccb03203e9b7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:09.567277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c48fd64d-008f-4376-81e8-ccb03203e9b7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:09.568221 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c48fd64d-008f-4376-81e8-ccb03203e9b7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:09.569832 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c48fd64d-008f-4376-81e8-ccb03203e9b7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:09.779927 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8e821c72-c2ef-4229-a35f-f634cfebee5d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:09.790178 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8e821c72-c2ef-4229-a35f-f634cfebee5d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.273914 Feb 21 04:16:09.791196 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 136/275] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:09 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:09.813821 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c48fd64d-008f-4376-81e8-ccb03203e9b7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:09.834976 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c48fd64d-008f-4376-81e8-ccb03203e9b7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.285951 Feb 21 04:16:09.835850 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 140/276] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:09 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:10.083498 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e0a6867c-2e4d-4d88-9e17-0567c0dc7742 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:10.084744 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e0a6867c-2e4d-4d88-9e17-0567c0dc7742 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:10.091175 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e0a6867c-2e4d-4d88-9e17-0567c0dc7742 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:10.091887 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e0a6867c-2e4d-4d88-9e17-0567c0dc7742 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:10.093022 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e0a6867c-2e4d-4d88-9e17-0567c0dc7742 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:10.093666 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e0a6867c-2e4d-4d88-9e17-0567c0dc7742 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:10.369472 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e0a6867c-2e4d-4d88-9e17-0567c0dc7742 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:10.377066 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e0a6867c-2e4d-4d88-9e17-0567c0dc7742 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.297313 Feb 21 04:16:10.381849 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 137/277] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:10 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:10.528921 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6f0de741-35d2-420f-968f-7a25359db3f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:10.530974 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6f0de741-35d2-420f-968f-7a25359db3f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:10.549999 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6f0de741-35d2-420f-968f-7a25359db3f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:10.550525 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6f0de741-35d2-420f-968f-7a25359db3f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:10.554571 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6f0de741-35d2-420f-968f-7a25359db3f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:10.555020 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6f0de741-35d2-420f-968f-7a25359db3f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:10.804369 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6f0de741-35d2-420f-968f-7a25359db3f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:10.809984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-441894c9-9e96-48b8-a103-c58deefb90e0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:10.811110 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-441894c9-9e96-48b8-a103-c58deefb90e0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:10.818220 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6f0de741-35d2-420f-968f-7a25359db3f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.293611 Feb 21 04:16:10.819254 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 141/278] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:10 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:10.822834 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-441894c9-9e96-48b8-a103-c58deefb90e0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:10.823747 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-441894c9-9e96-48b8-a103-c58deefb90e0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:10.824448 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-441894c9-9e96-48b8-a103-c58deefb90e0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:10.824931 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-441894c9-9e96-48b8-a103-c58deefb90e0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:10.850980 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9ce5a63c-59a2-4c71-bc89-9ec80470d126 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:10.851783 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9ce5a63c-59a2-4c71-bc89-9ec80470d126 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:10.859384 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9ce5a63c-59a2-4c71-bc89-9ec80470d126 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:10.859865 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9ce5a63c-59a2-4c71-bc89-9ec80470d126 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:10.866553 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9ce5a63c-59a2-4c71-bc89-9ec80470d126 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:10.867359 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9ce5a63c-59a2-4c71-bc89-9ec80470d126 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:11.121727 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-441894c9-9e96-48b8-a103-c58deefb90e0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:11.130608 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-441894c9-9e96-48b8-a103-c58deefb90e0 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.324860 Feb 21 04:16:11.132126 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 138/279] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:10 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:11.135149 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9ce5a63c-59a2-4c71-bc89-9ec80470d126 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:11.151871 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9ce5a63c-59a2-4c71-bc89-9ec80470d126 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.304028 Feb 21 04:16:11.152773 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 142/280] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:10 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:11.397042 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c716e98c-06fb-4c96-bb2d-7fe9ee244233 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:11.398220 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c716e98c-06fb-4c96-bb2d-7fe9ee244233 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:11.406134 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c716e98c-06fb-4c96-bb2d-7fe9ee244233 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:11.406581 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c716e98c-06fb-4c96-bb2d-7fe9ee244233 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:11.407417 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c716e98c-06fb-4c96-bb2d-7fe9ee244233 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:11.407928 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c716e98c-06fb-4c96-bb2d-7fe9ee244233 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:11.658997 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c716e98c-06fb-4c96-bb2d-7fe9ee244233 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:11.667633 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c716e98c-06fb-4c96-bb2d-7fe9ee244233 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.274221 Feb 21 04:16:11.677967 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 139/281] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:11 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:11.838435 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4a326f6d-0791-4249-be66-e10e117798a2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:11.839377 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4a326f6d-0791-4249-be66-e10e117798a2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:11.851731 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-4b81a0d4-480f-4c06-b0c8-5b413634f601 req-475c96e6-8971-4f1f-b709-51cab7553fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a128817-df9b-46f1-902b-03d1cbcddb7d", "name": "network-vif-plugged", "status": "completed", "tag": "ad59d774-1de8-45e3-a9d1-6d9c1aeca36e"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:11.856739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4a326f6d-0791-4249-be66-e10e117798a2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:11.856880 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:16:11.856880 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:16:11.857062 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4a326f6d-0791-4249-be66-e10e117798a2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:11.857062 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4a326f6d-0791-4249-be66-e10e117798a2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:11.857062 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4a326f6d-0791-4249-be66-e10e117798a2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:11.872464 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-4b81a0d4-480f-4c06-b0c8-5b413634f601 req-475c96e6-8971-4f1f-b709-51cab7553fbe service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:11.876854 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-4b81a0d4-480f-4c06-b0c8-5b413634f601 req-475c96e6-8971-4f1f-b709-51cab7553fbe service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:11.925371 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-4b81a0d4-480f-4c06-b0c8-5b413634f601 req-475c96e6-8971-4f1f-b709-51cab7553fbe service nova] Creating event network-vif-plugged:ad59d774-1de8-45e3-a9d1-6d9c1aeca36e for instance 4a128817-df9b-46f1-902b-03d1cbcddb7d on hv-cinder-77398 Feb 21 04:16:11.938299 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-4b81a0d4-480f-4c06-b0c8-5b413634f601 req-475c96e6-8971-4f1f-b709-51cab7553fbe service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090712 Feb 21 04:16:11.938909 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 140/282] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:16:12.149623 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-adf8e54c-9b76-4323-8452-1d808d16925f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:12.150327 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-adf8e54c-9b76-4323-8452-1d808d16925f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:12.168709 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-adf8e54c-9b76-4323-8452-1d808d16925f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:12.169198 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-adf8e54c-9b76-4323-8452-1d808d16925f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:12.170056 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-adf8e54c-9b76-4323-8452-1d808d16925f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:12.177216 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-adf8e54c-9b76-4323-8452-1d808d16925f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:12.181112 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4a326f6d-0791-4249-be66-e10e117798a2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:12.190412 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4a326f6d-0791-4249-be66-e10e117798a2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.358042 Feb 21 04:16:12.191622 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 143/283] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:11 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:12.196043 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-30020d4e-dad2-4859-91b8-b84a55b4c307 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:12.196867 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-30020d4e-dad2-4859-91b8-b84a55b4c307 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:12.212741 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-30020d4e-dad2-4859-91b8-b84a55b4c307 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:12.213572 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-30020d4e-dad2-4859-91b8-b84a55b4c307 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:12.214536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-30020d4e-dad2-4859-91b8-b84a55b4c307 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:12.215176 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-30020d4e-dad2-4859-91b8-b84a55b4c307 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:12.422704 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-adf8e54c-9b76-4323-8452-1d808d16925f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:12.432546 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-adf8e54c-9b76-4323-8452-1d808d16925f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.287022 Feb 21 04:16:12.433995 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 141/284] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:12 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:12.490947 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-30020d4e-dad2-4859-91b8-b84a55b4c307 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:12.502570 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-30020d4e-dad2-4859-91b8-b84a55b4c307 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.309207 Feb 21 04:16:12.503411 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 144/285] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:12 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:12.684070 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5a15fbc3-9f10-465a-8398-5dd411e71710 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:12.684938 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5a15fbc3-9f10-465a-8398-5dd411e71710 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:12.692438 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a15fbc3-9f10-465a-8398-5dd411e71710 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:12.692990 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a15fbc3-9f10-465a-8398-5dd411e71710 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:12.693765 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a15fbc3-9f10-465a-8398-5dd411e71710 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:12.694194 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a15fbc3-9f10-465a-8398-5dd411e71710 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:12.867831 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5a15fbc3-9f10-465a-8398-5dd411e71710 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:12.879842 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5a15fbc3-9f10-465a-8398-5dd411e71710 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.199427 Feb 21 04:16:12.890251 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 142/286] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:12 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:13.215132 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5c0c9dc6-826b-4120-b634-f6ea6711b273 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:13.215753 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5c0c9dc6-826b-4120-b634-f6ea6711b273 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:13.222688 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5c0c9dc6-826b-4120-b634-f6ea6711b273 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:13.223147 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5c0c9dc6-826b-4120-b634-f6ea6711b273 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:13.223938 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5c0c9dc6-826b-4120-b634-f6ea6711b273 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:13.224370 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5c0c9dc6-826b-4120-b634-f6ea6711b273 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:13.450554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f63219e1-22b2-499b-988c-9f17eec2cc58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:13.451892 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f63219e1-22b2-499b-988c-9f17eec2cc58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:13.459428 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f63219e1-22b2-499b-988c-9f17eec2cc58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:13.462068 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f63219e1-22b2-499b-988c-9f17eec2cc58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:13.463508 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f63219e1-22b2-499b-988c-9f17eec2cc58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:13.465217 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f63219e1-22b2-499b-988c-9f17eec2cc58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:13.533189 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5c0c9dc6-826b-4120-b634-f6ea6711b273 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:13.545092 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5c0c9dc6-826b-4120-b634-f6ea6711b273 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.333239 Feb 21 04:16:13.548775 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 145/287] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:13 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:13.570339 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-604688e5-9cc3-4968-9c55-ad2582721d89 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:13.574905 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-604688e5-9cc3-4968-9c55-ad2582721d89 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:13.585580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-604688e5-9cc3-4968-9c55-ad2582721d89 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:13.586236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-604688e5-9cc3-4968-9c55-ad2582721d89 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:13.587084 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-604688e5-9cc3-4968-9c55-ad2582721d89 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:13.587527 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-604688e5-9cc3-4968-9c55-ad2582721d89 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:13.710129 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f63219e1-22b2-499b-988c-9f17eec2cc58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:13.721609 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f63219e1-22b2-499b-988c-9f17eec2cc58 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.274811 Feb 21 04:16:13.736972 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 143/288] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:13 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:13.790800 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-604688e5-9cc3-4968-9c55-ad2582721d89 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:13.800495 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-604688e5-9cc3-4968-9c55-ad2582721d89 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.250432 Feb 21 04:16:13.802596 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 146/289] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:13 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:13.896853 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-caa4d5b6-cd97-4796-88a9-c71fabda760c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:13.897737 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-caa4d5b6-cd97-4796-88a9-c71fabda760c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:13.903741 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-caa4d5b6-cd97-4796-88a9-c71fabda760c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:13.904190 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-caa4d5b6-cd97-4796-88a9-c71fabda760c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:13.905887 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-caa4d5b6-cd97-4796-88a9-c71fabda760c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:13.906321 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-caa4d5b6-cd97-4796-88a9-c71fabda760c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:14.055151 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-caa4d5b6-cd97-4796-88a9-c71fabda760c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:14.064208 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-caa4d5b6-cd97-4796-88a9-c71fabda760c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.170833 Feb 21 04:16:14.074802 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 144/290] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:13 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:14.566280 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1086e18f-f280-4a56-aee8-1d13e8638473 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:14.568768 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1086e18f-f280-4a56-aee8-1d13e8638473 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:14.579139 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1086e18f-f280-4a56-aee8-1d13e8638473 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:14.579799 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1086e18f-f280-4a56-aee8-1d13e8638473 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:14.580932 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1086e18f-f280-4a56-aee8-1d13e8638473 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:14.581664 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1086e18f-f280-4a56-aee8-1d13e8638473 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:14.743153 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c37145ab-f604-41ed-af29-657708bc8cff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:14.745424 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c37145ab-f604-41ed-af29-657708bc8cff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:14.764920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c37145ab-f604-41ed-af29-657708bc8cff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:14.765799 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c37145ab-f604-41ed-af29-657708bc8cff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:14.766821 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c37145ab-f604-41ed-af29-657708bc8cff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:14.776674 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c37145ab-f604-41ed-af29-657708bc8cff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:14.812207 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1086e18f-f280-4a56-aee8-1d13e8638473 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:14.821743 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1086e18f-f280-4a56-aee8-1d13e8638473 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.262797 Feb 21 04:16:14.825339 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 147/291] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:14 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:14.832700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-dacbf407-a2af-436b-b237-0e9b38408936 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:14.842525 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-dacbf407-a2af-436b-b237-0e9b38408936 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:14.878279 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dacbf407-a2af-436b-b237-0e9b38408936 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:14.879040 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dacbf407-a2af-436b-b237-0e9b38408936 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:14.880348 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dacbf407-a2af-436b-b237-0e9b38408936 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:14.881258 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dacbf407-a2af-436b-b237-0e9b38408936 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:15.200707 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c37145ab-f604-41ed-af29-657708bc8cff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:15.209721 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c37145ab-f604-41ed-af29-657708bc8cff tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.470638 Feb 21 04:16:15.210425 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 145/292] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:14 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:15.237477 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3a7c11d0-1131-46b5-bb63-abd2d2036b62 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:15.241294 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3a7c11d0-1131-46b5-bb63-abd2d2036b62 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:15.261744 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a7c11d0-1131-46b5-bb63-abd2d2036b62 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:15.262531 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a7c11d0-1131-46b5-bb63-abd2d2036b62 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:15.263561 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a7c11d0-1131-46b5-bb63-abd2d2036b62 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:15.265643 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a7c11d0-1131-46b5-bb63-abd2d2036b62 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:15.279604 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dacbf407-a2af-436b-b237-0e9b38408936 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:15.287471 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-dacbf407-a2af-436b-b237-0e9b38408936 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.460709 Feb 21 04:16:15.293253 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 148/293] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:14 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:15.499660 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3a7c11d0-1131-46b5-bb63-abd2d2036b62 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:15.507020 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3a7c11d0-1131-46b5-bb63-abd2d2036b62 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.285760 Feb 21 04:16:15.507606 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 146/294] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:15 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:15.841295 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7a45bd05-f9b0-4875-b196-48d5e250cb6a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:15.841906 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7a45bd05-f9b0-4875-b196-48d5e250cb6a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:15.851489 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7a45bd05-f9b0-4875-b196-48d5e250cb6a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:15.852025 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7a45bd05-f9b0-4875-b196-48d5e250cb6a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:15.854292 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7a45bd05-f9b0-4875-b196-48d5e250cb6a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:15.855795 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7a45bd05-f9b0-4875-b196-48d5e250cb6a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:16.075096 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7a45bd05-f9b0-4875-b196-48d5e250cb6a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:16.083536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7a45bd05-f9b0-4875-b196-48d5e250cb6a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.246097 Feb 21 04:16:16.084096 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 149/295] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:15 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:16.231854 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9f31b329-35df-4bc2-b348-44b08a40dcea tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:16.233181 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9f31b329-35df-4bc2-b348-44b08a40dcea tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:16.252920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9f31b329-35df-4bc2-b348-44b08a40dcea tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:16.254050 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9f31b329-35df-4bc2-b348-44b08a40dcea tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:16.255904 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9f31b329-35df-4bc2-b348-44b08a40dcea tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:16.256715 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9f31b329-35df-4bc2-b348-44b08a40dcea tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:16.327711 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-02c040a8-c21a-4d59-a4fa-2b412b91e2c2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:16.329075 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-02c040a8-c21a-4d59-a4fa-2b412b91e2c2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:16.345533 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-02c040a8-c21a-4d59-a4fa-2b412b91e2c2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:16.346580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-02c040a8-c21a-4d59-a4fa-2b412b91e2c2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:16.348700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-02c040a8-c21a-4d59-a4fa-2b412b91e2c2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:16.349609 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-02c040a8-c21a-4d59-a4fa-2b412b91e2c2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:16.634324 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9f31b329-35df-4bc2-b348-44b08a40dcea tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:16.647920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9f31b329-35df-4bc2-b348-44b08a40dcea tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.423322 Feb 21 04:16:16.656662 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 147/296] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:16 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:16.658497 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0bf027d4-5856-4ef3-ae98-a4e6dc379a32 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:16.661719 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0bf027d4-5856-4ef3-ae98-a4e6dc379a32 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:16.675920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0bf027d4-5856-4ef3-ae98-a4e6dc379a32 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:16.678739 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0bf027d4-5856-4ef3-ae98-a4e6dc379a32 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:16.679905 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0bf027d4-5856-4ef3-ae98-a4e6dc379a32 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:16.680936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0bf027d4-5856-4ef3-ae98-a4e6dc379a32 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:16.782929 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-02c040a8-c21a-4d59-a4fa-2b412b91e2c2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:16.792535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-02c040a8-c21a-4d59-a4fa-2b412b91e2c2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.478087 Feb 21 04:16:16.797470 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 150/297] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:16 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:16.914632 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0bf027d4-5856-4ef3-ae98-a4e6dc379a32 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:16.923244 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0bf027d4-5856-4ef3-ae98-a4e6dc379a32 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.271402 Feb 21 04:16:16.923830 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 148/298] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:16 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:17.100598 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-295f0480-f626-4951-81f3-1e392ce22e2e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:17.102004 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-295f0480-f626-4951-81f3-1e392ce22e2e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:17.110677 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-295f0480-f626-4951-81f3-1e392ce22e2e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:17.111128 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-295f0480-f626-4951-81f3-1e392ce22e2e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:17.111918 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-295f0480-f626-4951-81f3-1e392ce22e2e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:17.112351 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-295f0480-f626-4951-81f3-1e392ce22e2e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:17.338616 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-295f0480-f626-4951-81f3-1e392ce22e2e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:17.350178 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-295f0480-f626-4951-81f3-1e392ce22e2e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.253352 Feb 21 04:16:17.351825 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 151/299] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:17 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:17.666644 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-65ab0ff4-1abf-4a16-94a0-c50f49dfdbe6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:17.667277 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-65ab0ff4-1abf-4a16-94a0-c50f49dfdbe6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:17.673085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-65ab0ff4-1abf-4a16-94a0-c50f49dfdbe6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:17.673489 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-65ab0ff4-1abf-4a16-94a0-c50f49dfdbe6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:17.674264 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-65ab0ff4-1abf-4a16-94a0-c50f49dfdbe6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:17.674697 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-65ab0ff4-1abf-4a16-94a0-c50f49dfdbe6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:17.817963 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-dc882ca9-01dc-45d2-8f8e-a46fb1967f04 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:17.818310 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-dc882ca9-01dc-45d2-8f8e-a46fb1967f04 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:17.831696 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc882ca9-01dc-45d2-8f8e-a46fb1967f04 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:17.832377 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc882ca9-01dc-45d2-8f8e-a46fb1967f04 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:17.833393 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc882ca9-01dc-45d2-8f8e-a46fb1967f04 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:17.834139 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc882ca9-01dc-45d2-8f8e-a46fb1967f04 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:17.994772 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-65ab0ff4-1abf-4a16-94a0-c50f49dfdbe6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:18.005861 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-65ab0ff4-1abf-4a16-94a0-c50f49dfdbe6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.342691 Feb 21 04:16:18.007035 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 149/300] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:17 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:18.013404 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-263ccf76-a09b-4747-bcdb-57e88388458c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:18.015114 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-263ccf76-a09b-4747-bcdb-57e88388458c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:18.022086 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-263ccf76-a09b-4747-bcdb-57e88388458c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:18.032188 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-263ccf76-a09b-4747-bcdb-57e88388458c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:18.033479 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-263ccf76-a09b-4747-bcdb-57e88388458c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:18.037466 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-263ccf76-a09b-4747-bcdb-57e88388458c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:18.141450 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dc882ca9-01dc-45d2-8f8e-a46fb1967f04 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:18.149642 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-dc882ca9-01dc-45d2-8f8e-a46fb1967f04 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.335592 Feb 21 04:16:18.150665 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 152/301] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:17 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:18.272451 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-263ccf76-a09b-4747-bcdb-57e88388458c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:18.313493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-263ccf76-a09b-4747-bcdb-57e88388458c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.304411 Feb 21 04:16:18.314348 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 150/302] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:18 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:18.368347 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8264645c-601f-4ca3-94ef-e3e36107cdcb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:18.369098 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-8264645c-601f-4ca3-94ef-e3e36107cdcb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:18.377600 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8264645c-601f-4ca3-94ef-e3e36107cdcb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:18.377600 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8264645c-601f-4ca3-94ef-e3e36107cdcb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:18.377600 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8264645c-601f-4ca3-94ef-e3e36107cdcb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:18.377600 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8264645c-601f-4ca3-94ef-e3e36107cdcb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:18.542598 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8264645c-601f-4ca3-94ef-e3e36107cdcb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:18.553316 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-8264645c-601f-4ca3-94ef-e3e36107cdcb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.188073 Feb 21 04:16:18.564087 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 153/303] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:18 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:19.022804 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-11e91c1f-0ce7-4a96-8bd6-5d48311cc59e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:19.023424 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-11e91c1f-0ce7-4a96-8bd6-5d48311cc59e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:19.030125 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-11e91c1f-0ce7-4a96-8bd6-5d48311cc59e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:19.030578 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-11e91c1f-0ce7-4a96-8bd6-5d48311cc59e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:19.031427 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-11e91c1f-0ce7-4a96-8bd6-5d48311cc59e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:19.031926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-11e91c1f-0ce7-4a96-8bd6-5d48311cc59e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:19.166994 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-878a0632-4cd5-45c0-80cd-a62eaacdee3b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:19.167615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-878a0632-4cd5-45c0-80cd-a62eaacdee3b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:19.172437 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-11e91c1f-0ce7-4a96-8bd6-5d48311cc59e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:19.174110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-878a0632-4cd5-45c0-80cd-a62eaacdee3b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:19.174567 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-878a0632-4cd5-45c0-80cd-a62eaacdee3b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:19.175393 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-878a0632-4cd5-45c0-80cd-a62eaacdee3b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:19.176119 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-878a0632-4cd5-45c0-80cd-a62eaacdee3b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:19.179872 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-11e91c1f-0ce7-4a96-8bd6-5d48311cc59e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.160602 Feb 21 04:16:19.181044 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 151/304] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:19 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:19.319501 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-878a0632-4cd5-45c0-80cd-a62eaacdee3b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:19.330341 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-78166f67-9191-41a4-87a8-e5d876724457 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:19.330950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-78166f67-9191-41a4-87a8-e5d876724457 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:19.335716 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-878a0632-4cd5-45c0-80cd-a62eaacdee3b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.172565 Feb 21 04:16:19.336491 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 154/305] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:19 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:19.346363 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-78166f67-9191-41a4-87a8-e5d876724457 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:19.346834 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-78166f67-9191-41a4-87a8-e5d876724457 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:19.347755 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-78166f67-9191-41a4-87a8-e5d876724457 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:19.348044 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-78166f67-9191-41a4-87a8-e5d876724457 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:19.479594 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-78166f67-9191-41a4-87a8-e5d876724457 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:19.486669 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-78166f67-9191-41a4-87a8-e5d876724457 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.160479 Feb 21 04:16:19.487230 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 152/306] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:19 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:19.570606 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8372129f-7fe5-4584-a7b4-a79e0dd3c36a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:19.571220 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-8372129f-7fe5-4584-a7b4-a79e0dd3c36a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:19.576966 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8372129f-7fe5-4584-a7b4-a79e0dd3c36a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:19.577437 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8372129f-7fe5-4584-a7b4-a79e0dd3c36a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:19.578193 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8372129f-7fe5-4584-a7b4-a79e0dd3c36a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:19.578628 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8372129f-7fe5-4584-a7b4-a79e0dd3c36a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:19.737128 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8372129f-7fe5-4584-a7b4-a79e0dd3c36a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:19.745248 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-8372129f-7fe5-4584-a7b4-a79e0dd3c36a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.177893 Feb 21 04:16:19.746178 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 155/307] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:19 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:20.199004 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d37e141b-5996-4092-bdf9-84a8da62a586 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:20.199666 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d37e141b-5996-4092-bdf9-84a8da62a586 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:20.206652 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d37e141b-5996-4092-bdf9-84a8da62a586 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:20.207416 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d37e141b-5996-4092-bdf9-84a8da62a586 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:20.208497 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d37e141b-5996-4092-bdf9-84a8da62a586 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:20.209004 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d37e141b-5996-4092-bdf9-84a8da62a586 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:20.353836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-798b3bc7-4e93-4fea-b8e3-253aa9c7b86c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:20.354460 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-798b3bc7-4e93-4fea-b8e3-253aa9c7b86c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:20.360411 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d37e141b-5996-4092-bdf9-84a8da62a586 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:20.361543 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-798b3bc7-4e93-4fea-b8e3-253aa9c7b86c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:20.362140 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-798b3bc7-4e93-4fea-b8e3-253aa9c7b86c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:20.363042 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-798b3bc7-4e93-4fea-b8e3-253aa9c7b86c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:20.364035 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-798b3bc7-4e93-4fea-b8e3-253aa9c7b86c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:20.374899 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d37e141b-5996-4092-bdf9-84a8da62a586 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.181194 Feb 21 04:16:20.386542 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 153/308] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:20 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:20.507276 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-42ec1aca-0adc-4dba-b3fa-8c61cafb5895 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:20.507890 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-42ec1aca-0adc-4dba-b3fa-8c61cafb5895 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:20.512553 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-798b3bc7-4e93-4fea-b8e3-253aa9c7b86c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:20.514444 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-42ec1aca-0adc-4dba-b3fa-8c61cafb5895 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:20.515037 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-42ec1aca-0adc-4dba-b3fa-8c61cafb5895 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:20.515995 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-42ec1aca-0adc-4dba-b3fa-8c61cafb5895 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:20.516427 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-42ec1aca-0adc-4dba-b3fa-8c61cafb5895 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:20.521292 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-798b3bc7-4e93-4fea-b8e3-253aa9c7b86c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.172576 Feb 21 04:16:20.521962 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 156/309] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:20 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:20.655258 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-42ec1aca-0adc-4dba-b3fa-8c61cafb5895 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:20.662430 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-42ec1aca-0adc-4dba-b3fa-8c61cafb5895 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.162961 Feb 21 04:16:20.662987 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 154/310] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:20 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:20.762784 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-46253259-a004-42d1-8e6b-e6708b0a6bfe tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:20.763435 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-46253259-a004-42d1-8e6b-e6708b0a6bfe tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:20.769951 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-46253259-a004-42d1-8e6b-e6708b0a6bfe tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:20.770053 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-46253259-a004-42d1-8e6b-e6708b0a6bfe tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:20.770839 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-46253259-a004-42d1-8e6b-e6708b0a6bfe tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:20.771457 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-46253259-a004-42d1-8e6b-e6708b0a6bfe tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:20.905248 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-46253259-a004-42d1-8e6b-e6708b0a6bfe tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:20.913214 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-46253259-a004-42d1-8e6b-e6708b0a6bfe tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.154043 Feb 21 04:16:20.913808 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 157/311] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:20 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:21.392129 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-16905f50-c4f3-454e-bbfd-331795b37ec1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:21.392833 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-16905f50-c4f3-454e-bbfd-331795b37ec1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:21.398819 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16905f50-c4f3-454e-bbfd-331795b37ec1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:21.399349 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16905f50-c4f3-454e-bbfd-331795b37ec1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:21.400213 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16905f50-c4f3-454e-bbfd-331795b37ec1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:21.400748 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16905f50-c4f3-454e-bbfd-331795b37ec1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:21.553701 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-24877a3d-99a3-4990-b1db-6de0d2adc11c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:21.556053 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-24877a3d-99a3-4990-b1db-6de0d2adc11c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:21.588973 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-24877a3d-99a3-4990-b1db-6de0d2adc11c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:21.590367 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-24877a3d-99a3-4990-b1db-6de0d2adc11c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:21.591695 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-24877a3d-99a3-4990-b1db-6de0d2adc11c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:21.592143 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-24877a3d-99a3-4990-b1db-6de0d2adc11c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:21.975803 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-16905f50-c4f3-454e-bbfd-331795b37ec1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:21.984084 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-16905f50-c4f3-454e-bbfd-331795b37ec1 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.596333 Feb 21 04:16:21.984764 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 155/312] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:21 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:21.989201 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a47e2a84-09e1-44cb-93cd-d06e346fec3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:21.989866 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a47e2a84-09e1-44cb-93cd-d06e346fec3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:21.996519 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a47e2a84-09e1-44cb-93cd-d06e346fec3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:21.997068 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a47e2a84-09e1-44cb-93cd-d06e346fec3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:21.998480 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a47e2a84-09e1-44cb-93cd-d06e346fec3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:21.998988 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a47e2a84-09e1-44cb-93cd-d06e346fec3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:22.211512 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-24877a3d-99a3-4990-b1db-6de0d2adc11c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:22.219996 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-24877a3d-99a3-4990-b1db-6de0d2adc11c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.683974 Feb 21 04:16:22.229168 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 158/313] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:21 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:22.229168 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1a5c1009-e0a6-4212-8b64-b9c76ae39c7b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:22.229168 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1a5c1009-e0a6-4212-8b64-b9c76ae39c7b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:22.233171 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a5c1009-e0a6-4212-8b64-b9c76ae39c7b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:22.234114 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a5c1009-e0a6-4212-8b64-b9c76ae39c7b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:22.234710 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a5c1009-e0a6-4212-8b64-b9c76ae39c7b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:22.235230 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a5c1009-e0a6-4212-8b64-b9c76ae39c7b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:22.459490 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a47e2a84-09e1-44cb-93cd-d06e346fec3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:22.468732 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a47e2a84-09e1-44cb-93cd-d06e346fec3f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.482830 Feb 21 04:16:22.479427 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 156/314] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:21 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:22.537972 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-68b4090f-6ef1-4beb-881c-9e7818b8ff18 req-9fdf3db8-c9b6-40d1-a41d-dc08a0ece475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59362492-1a50-4bb3-a8a7-b29eb51489e4", "tag": "2f0ab78e-d156-44f8-a2e4-b409bf502408"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:22.540503 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:16:22.540503 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:16:22.550317 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-68b4090f-6ef1-4beb-881c-9e7818b8ff18 req-9fdf3db8-c9b6-40d1-a41d-dc08a0ece475 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:22.551089 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-68b4090f-6ef1-4beb-881c-9e7818b8ff18 req-9fdf3db8-c9b6-40d1-a41d-dc08a0ece475 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:22.588938 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-68b4090f-6ef1-4beb-881c-9e7818b8ff18 req-9fdf3db8-c9b6-40d1-a41d-dc08a0ece475 service nova] Creating event network-changed:2f0ab78e-d156-44f8-a2e4-b409bf502408 for instance 59362492-1a50-4bb3-a8a7-b29eb51489e4 on hv-cinder-77398 Feb 21 04:16:22.600280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-68b4090f-6ef1-4beb-881c-9e7818b8ff18 req-9fdf3db8-c9b6-40d1-a41d-dc08a0ece475 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065863 Feb 21 04:16:22.600790 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 157/315] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:16:22.692872 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1a5c1009-e0a6-4212-8b64-b9c76ae39c7b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:22.700487 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1a5c1009-e0a6-4212-8b64-b9c76ae39c7b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.478733 Feb 21 04:16:22.704244 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 159/316] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:22 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:23.004532 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-38a0e25d-7063-4998-8df6-df3f8416bc3d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:23.005279 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-38a0e25d-7063-4998-8df6-df3f8416bc3d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:23.014639 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-38a0e25d-7063-4998-8df6-df3f8416bc3d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:23.015088 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-38a0e25d-7063-4998-8df6-df3f8416bc3d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:23.016368 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-38a0e25d-7063-4998-8df6-df3f8416bc3d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:23.017158 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-38a0e25d-7063-4998-8df6-df3f8416bc3d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:23.236202 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b254b795-f559-413b-9fc1-4aee9185d314 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:23.236867 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b254b795-f559-413b-9fc1-4aee9185d314 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:23.246197 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b254b795-f559-413b-9fc1-4aee9185d314 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:23.246650 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b254b795-f559-413b-9fc1-4aee9185d314 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:23.247656 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b254b795-f559-413b-9fc1-4aee9185d314 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:23.257109 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b254b795-f559-413b-9fc1-4aee9185d314 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:23.347331 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-38a0e25d-7063-4998-8df6-df3f8416bc3d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:23.354850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-38a0e25d-7063-4998-8df6-df3f8416bc3d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.357030 Feb 21 04:16:23.356014 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 158/317] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:22 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:23.488078 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-18ada846-2c73-4d1d-ad51-d71e6d5f2597 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:23.490051 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-18ada846-2c73-4d1d-ad51-d71e6d5f2597 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:23.506715 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b254b795-f559-413b-9fc1-4aee9185d314 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:23.512526 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18ada846-2c73-4d1d-ad51-d71e6d5f2597 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:23.514988 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18ada846-2c73-4d1d-ad51-d71e6d5f2597 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:23.516192 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18ada846-2c73-4d1d-ad51-d71e6d5f2597 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:23.518058 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18ada846-2c73-4d1d-ad51-d71e6d5f2597 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:23.519463 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b254b795-f559-413b-9fc1-4aee9185d314 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.287327 Feb 21 04:16:23.520068 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 160/318] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:23 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:23.724190 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1c1dbdcc-5f54-47ff-a67f-393254a9326c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:23.726270 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1c1dbdcc-5f54-47ff-a67f-393254a9326c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:23.737094 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1c1dbdcc-5f54-47ff-a67f-393254a9326c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:23.747634 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1c1dbdcc-5f54-47ff-a67f-393254a9326c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:23.749377 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1c1dbdcc-5f54-47ff-a67f-393254a9326c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:23.750396 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1c1dbdcc-5f54-47ff-a67f-393254a9326c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:23.844181 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-18ada846-2c73-4d1d-ad51-d71e6d5f2597 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:23.864775 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-18ada846-2c73-4d1d-ad51-d71e6d5f2597 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1318 microversion: 2.1 time: 0.381194 Feb 21 04:16:23.874544 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 159/319] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:23 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:24.083552 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1c1dbdcc-5f54-47ff-a67f-393254a9326c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:24.092623 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1c1dbdcc-5f54-47ff-a67f-393254a9326c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.374156 Feb 21 04:16:24.093654 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 161/320] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:23 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:24.372716 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1711a23b-ebb6-4e1b-83b7-4d741bab694a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:24.376718 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1711a23b-ebb6-4e1b-83b7-4d741bab694a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:24.385846 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1711a23b-ebb6-4e1b-83b7-4d741bab694a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:24.386305 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1711a23b-ebb6-4e1b-83b7-4d741bab694a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:24.387100 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1711a23b-ebb6-4e1b-83b7-4d741bab694a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:24.387837 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1711a23b-ebb6-4e1b-83b7-4d741bab694a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:24.531246 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1711a23b-ebb6-4e1b-83b7-4d741bab694a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:24.541535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b56908bd-2e81-4975-812c-eb2e541d88f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:24.541700 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1711a23b-ebb6-4e1b-83b7-4d741bab694a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1501 microversion: 2.1 time: 0.172965 Feb 21 04:16:24.542156 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 160/321] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:24 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1501 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:24.543201 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b56908bd-2e81-4975-812c-eb2e541d88f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:24.550109 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b56908bd-2e81-4975-812c-eb2e541d88f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:24.550728 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b56908bd-2e81-4975-812c-eb2e541d88f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:24.551630 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b56908bd-2e81-4975-812c-eb2e541d88f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:24.552137 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b56908bd-2e81-4975-812c-eb2e541d88f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:24.560960 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-08537c37-cbdd-4dfc-9a8f-977cacdf098b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98acbbee-6ece-4553-bc4f-555137d9101b"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:24.562827 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-08537c37-cbdd-4dfc-9a8f-977cacdf098b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:24.570400 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-08537c37-cbdd-4dfc-9a8f-977cacdf098b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:24.570788 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-08537c37-cbdd-4dfc-9a8f-977cacdf098b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:24.571791 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-08537c37-cbdd-4dfc-9a8f-977cacdf098b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:24.572338 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-08537c37-cbdd-4dfc-9a8f-977cacdf098b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:24.605510 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-08537c37-cbdd-4dfc-9a8f-977cacdf098b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] HTTP exception thrown: Cannot 'attach_volume' instance 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d while it is in vm_state rescued Feb 21 04:16:24.606138 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-08537c37-cbdd-4dfc-9a8f-977cacdf098b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Returning 409 to user: Cannot 'attach_volume' instance 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d while it is in vm_state rescued {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:16:24.606966 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-08537c37-cbdd-4dfc-9a8f-977cacdf098b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "POST /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051058 Feb 21 04:16:24.608136 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 161/322] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:16:24 2022] POST /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 21 04:16:24.617714 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-84ac9086-d05c-4bd3-81f2-18ca0d2e395e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:24.618712 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-84ac9086-d05c-4bd3-81f2-18ca0d2e395e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:24.625556 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-84ac9086-d05c-4bd3-81f2-18ca0d2e395e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:24.626318 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-84ac9086-d05c-4bd3-81f2-18ca0d2e395e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:24.627306 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-84ac9086-d05c-4bd3-81f2-18ca0d2e395e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:24.627920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-84ac9086-d05c-4bd3-81f2-18ca0d2e395e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:24.726570 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b56908bd-2e81-4975-812c-eb2e541d88f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:24.733898 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-84ac9086-d05c-4bd3-81f2-18ca0d2e395e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "POST /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/action" status: 202 len: 0 microversion: 2.1 time: 0.119067 Feb 21 04:16:24.735042 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 162/323] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:16:24 2022] POST /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:16:24.752825 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b56908bd-2e81-4975-812c-eb2e541d88f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.218992 Feb 21 04:16:24.764778 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 162/324] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:24 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:24.768510 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a18fc789-056f-4e8d-87de-2dd29422f30c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:24.769624 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a18fc789-056f-4e8d-87de-2dd29422f30c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:24.790188 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a18fc789-056f-4e8d-87de-2dd29422f30c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:24.790797 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a18fc789-056f-4e8d-87de-2dd29422f30c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:24.792510 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a18fc789-056f-4e8d-87de-2dd29422f30c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:24.793214 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a18fc789-056f-4e8d-87de-2dd29422f30c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:24.881269 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-29249e76-764b-443f-a539-50d0ffdfb483 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:24.882142 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-29249e76-764b-443f-a539-50d0ffdfb483 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:24.890223 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-29249e76-764b-443f-a539-50d0ffdfb483 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:24.890978 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-29249e76-764b-443f-a539-50d0ffdfb483 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:24.891951 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-29249e76-764b-443f-a539-50d0ffdfb483 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:24.892545 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-29249e76-764b-443f-a539-50d0ffdfb483 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:25.124463 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a18fc789-056f-4e8d-87de-2dd29422f30c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:25.131749 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a18fc789-056f-4e8d-87de-2dd29422f30c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1509 microversion: 2.1 time: 0.372452 Feb 21 04:16:25.132672 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 163/325] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:24 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1509 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:25.137514 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c1fafc04-0fbf-4fd8-a9f2-73a0920a2f52 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:25.138114 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c1fafc04-0fbf-4fd8-a9f2-73a0920a2f52 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:25.144185 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c1fafc04-0fbf-4fd8-a9f2-73a0920a2f52 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:25.144652 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c1fafc04-0fbf-4fd8-a9f2-73a0920a2f52 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:25.145676 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c1fafc04-0fbf-4fd8-a9f2-73a0920a2f52 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:25.146109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c1fafc04-0fbf-4fd8-a9f2-73a0920a2f52 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:25.331811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-29249e76-764b-443f-a539-50d0ffdfb483 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:25.343532 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-29249e76-764b-443f-a539-50d0ffdfb483 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1509 microversion: 2.1 time: 0.465937 Feb 21 04:16:25.356731 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 163/326] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:24 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1509 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:25.364978 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-86e06999-5656-4630-bed9-be58d6a9a25f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8df0147e-dba5-40e5-a9b2-948447ffde45"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:25.367183 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-86e06999-5656-4630-bed9-be58d6a9a25f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:25.381905 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-86e06999-5656-4630-bed9-be58d6a9a25f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:25.382678 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-86e06999-5656-4630-bed9-be58d6a9a25f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:25.383687 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-86e06999-5656-4630-bed9-be58d6a9a25f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:25.384314 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-86e06999-5656-4630-bed9-be58d6a9a25f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:25.504408 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c1fafc04-0fbf-4fd8-a9f2-73a0920a2f52 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:25.508376 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-86e06999-5656-4630-bed9-be58d6a9a25f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] HTTP exception thrown: Invalid volume: volume 8df0147e-dba5-40e5-a9b2-948447ffde45 is already attached to instances: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 Feb 21 04:16:25.510649 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-86e06999-5656-4630-bed9-be58d6a9a25f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Returning 400 to user: Invalid volume: volume 8df0147e-dba5-40e5-a9b2-948447ffde45 is already attached to instances: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:16:25.512234 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-86e06999-5656-4630-bed9-be58d6a9a25f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "POST /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.151287 Feb 21 04:16:25.515236 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c1fafc04-0fbf-4fd8-a9f2-73a0920a2f52 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.381258 Feb 21 04:16:25.516012 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 164/327] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:25 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:25.532896 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 164/328] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:16:25 2022] POST /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d/os-volume_attachments => generated 174 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 04:16:25.589913 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b72177c5-9c54-41cb-8a54-8620f8282b68 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:25.590951 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b72177c5-9c54-41cb-8a54-8620f8282b68 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:25.598614 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b72177c5-9c54-41cb-8a54-8620f8282b68 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:25.599336 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b72177c5-9c54-41cb-8a54-8620f8282b68 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:25.600316 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b72177c5-9c54-41cb-8a54-8620f8282b68 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:25.600950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b72177c5-9c54-41cb-8a54-8620f8282b68 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:25.775050 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-90c5ca53-d390-4074-b541-39fc0f7cc174 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:25.776226 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-90c5ca53-d390-4074-b541-39fc0f7cc174 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:25.783922 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-90c5ca53-d390-4074-b541-39fc0f7cc174 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:25.784548 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-90c5ca53-d390-4074-b541-39fc0f7cc174 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:25.786274 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-90c5ca53-d390-4074-b541-39fc0f7cc174 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:25.786871 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-90c5ca53-d390-4074-b541-39fc0f7cc174 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:25.934407 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-b72177c5-9c54-41cb-8a54-8620f8282b68 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lazy-loading 'services' on Instance uuid efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:16:25.960290 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-90c5ca53-d390-4074-b541-39fc0f7cc174 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:25.969446 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-90c5ca53-d390-4074-b541-39fc0f7cc174 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.197954 Feb 21 04:16:25.970625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 165/329] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:25 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:26.069689 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b72177c5-9c54-41cb-8a54-8620f8282b68 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "DELETE /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41/os-volume_attachments/8df0147e-dba5-40e5-a9b2-948447ffde45" status: 202 len: 0 microversion: 2.1 time: 0.483796 Feb 21 04:16:26.070553 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 165/330] 10.222.0.10 () {58 vars in 1415 bytes} [Mon Feb 21 04:16:25 2022] DELETE /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41/os-volume_attachments/8df0147e-dba5-40e5-a9b2-948447ffde45 => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:16:26.079367 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-759c5307-ae2d-4c31-964a-0cdce0498fc4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:26.080391 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-759c5307-ae2d-4c31-964a-0cdce0498fc4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:26.086423 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-759c5307-ae2d-4c31-964a-0cdce0498fc4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:26.086947 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-759c5307-ae2d-4c31-964a-0cdce0498fc4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:26.087687 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-759c5307-ae2d-4c31-964a-0cdce0498fc4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:26.088276 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-759c5307-ae2d-4c31-964a-0cdce0498fc4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:26.132358 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-759c5307-ae2d-4c31-964a-0cdce0498fc4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057347 Feb 21 04:16:26.133318 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 166/331] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:16:26 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:16:26.149977 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0b0488e2-a38b-4933-9ad1-e75a2acc836b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:26.150890 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0b0488e2-a38b-4933-9ad1-e75a2acc836b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:26.158154 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0b0488e2-a38b-4933-9ad1-e75a2acc836b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:26.158609 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0b0488e2-a38b-4933-9ad1-e75a2acc836b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:26.159580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0b0488e2-a38b-4933-9ad1-e75a2acc836b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:26.160240 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0b0488e2-a38b-4933-9ad1-e75a2acc836b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:26.535326 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1a158536-b9ee-420b-84c8-15430a41a65d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:26.536106 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1a158536-b9ee-420b-84c8-15430a41a65d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:26.542132 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a158536-b9ee-420b-84c8-15430a41a65d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:26.542585 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a158536-b9ee-420b-84c8-15430a41a65d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:26.543365 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a158536-b9ee-420b-84c8-15430a41a65d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:26.544309 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a158536-b9ee-420b-84c8-15430a41a65d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:26.621319 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0b0488e2-a38b-4933-9ad1-e75a2acc836b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:26.629211 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0b0488e2-a38b-4933-9ad1-e75a2acc836b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1509 microversion: 2.1 time: 0.484216 Feb 21 04:16:26.629859 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 166/332] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:26 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:26.771008 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1a158536-b9ee-420b-84c8-15430a41a65d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:26.790034 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1a158536-b9ee-420b-84c8-15430a41a65d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.259441 Feb 21 04:16:26.801466 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 167/333] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:26 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:26.988735 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-664f3a75-cad9-4281-9437-ae0200e48842 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:26.989445 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-664f3a75-cad9-4281-9437-ae0200e48842 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:26.995382 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-664f3a75-cad9-4281-9437-ae0200e48842 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:26.995827 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-664f3a75-cad9-4281-9437-ae0200e48842 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:26.996601 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-664f3a75-cad9-4281-9437-ae0200e48842 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:26.997065 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-664f3a75-cad9-4281-9437-ae0200e48842 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:27.143277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3714fdd5-d3b2-429b-bf6a-64685f7a4a70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:27.144237 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3714fdd5-d3b2-429b-bf6a-64685f7a4a70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:27.151909 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-664f3a75-cad9-4281-9437-ae0200e48842 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:27.154110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3714fdd5-d3b2-429b-bf6a-64685f7a4a70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:27.154678 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3714fdd5-d3b2-429b-bf6a-64685f7a4a70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:27.155541 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3714fdd5-d3b2-429b-bf6a-64685f7a4a70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:27.156027 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3714fdd5-d3b2-429b-bf6a-64685f7a4a70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:27.162862 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-664f3a75-cad9-4281-9437-ae0200e48842 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.177615 Feb 21 04:16:27.163357 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 167/334] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:26 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:27.197576 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3714fdd5-d3b2-429b-bf6a-64685f7a4a70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058096 Feb 21 04:16:27.198146 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 168/335] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:16:27 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:16:27.646547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-47bce41e-e938-4706-9ba9-a9403e858d97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:27.647164 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-47bce41e-e938-4706-9ba9-a9403e858d97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:27.653528 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-47bce41e-e938-4706-9ba9-a9403e858d97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:27.654554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-47bce41e-e938-4706-9ba9-a9403e858d97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:27.655346 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-47bce41e-e938-4706-9ba9-a9403e858d97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:27.655823 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-47bce41e-e938-4706-9ba9-a9403e858d97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:27.809497 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-892c7982-147f-46cf-a0e8-502caa7d6e84 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:27.810157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-892c7982-147f-46cf-a0e8-502caa7d6e84 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:27.816077 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-892c7982-147f-46cf-a0e8-502caa7d6e84 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:27.816850 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-892c7982-147f-46cf-a0e8-502caa7d6e84 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:27.817864 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-892c7982-147f-46cf-a0e8-502caa7d6e84 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:27.818811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-892c7982-147f-46cf-a0e8-502caa7d6e84 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:27.845264 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-47bce41e-e938-4706-9ba9-a9403e858d97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:27.854235 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-47bce41e-e938-4706-9ba9-a9403e858d97 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1509 microversion: 2.1 time: 0.211098 Feb 21 04:16:27.855135 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 168/336] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:27 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:27.998924 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-892c7982-147f-46cf-a0e8-502caa7d6e84 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:28.008764 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-892c7982-147f-46cf-a0e8-502caa7d6e84 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.203354 Feb 21 04:16:28.009892 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 169/337] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:27 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:28.144476 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-37189961-a892-41d8-8b9f-8ad9afd7ae45 req-0b5f28f2-4980-4084-834e-d56ae710a9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bf519a-d7d3-4837-9967-170c581923b9", "name": "network-vif-plugged", "status": "completed", "tag": "e3b4314c-490f-4b92-b46a-0ebe1ed983f0"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:28.146217 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:16:28.146217 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:16:28.153361 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-37189961-a892-41d8-8b9f-8ad9afd7ae45 req-0b5f28f2-4980-4084-834e-d56ae710a9fa service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:28.153642 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-37189961-a892-41d8-8b9f-8ad9afd7ae45 req-0b5f28f2-4980-4084-834e-d56ae710a9fa service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:28.170938 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-37189961-a892-41d8-8b9f-8ad9afd7ae45 req-0b5f28f2-4980-4084-834e-d56ae710a9fa service nova] Creating event network-vif-plugged:e3b4314c-490f-4b92-b46a-0ebe1ed983f0 for instance c4bf519a-d7d3-4837-9967-170c581923b9 on hv-cinder-77398 Feb 21 04:16:28.176064 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-37189961-a892-41d8-8b9f-8ad9afd7ae45 req-0b5f28f2-4980-4084-834e-d56ae710a9fa service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035204 Feb 21 04:16:28.176823 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 169/338] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:16:28.179261 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-05f1efb8-7c4d-4af1-8a8b-2586c9017e8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:28.179912 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-05f1efb8-7c4d-4af1-8a8b-2586c9017e8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:28.187131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-05f1efb8-7c4d-4af1-8a8b-2586c9017e8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:28.188236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-05f1efb8-7c4d-4af1-8a8b-2586c9017e8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:28.189149 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-05f1efb8-7c4d-4af1-8a8b-2586c9017e8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:28.189551 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-05f1efb8-7c4d-4af1-8a8b-2586c9017e8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:28.210463 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5c8b8e9c-01a5-4cce-bc37-41f6c7a5c059 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:28.212167 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5c8b8e9c-01a5-4cce-bc37-41f6c7a5c059 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:28.218383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c8b8e9c-01a5-4cce-bc37-41f6c7a5c059 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:28.219067 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c8b8e9c-01a5-4cce-bc37-41f6c7a5c059 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:28.219861 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c8b8e9c-01a5-4cce-bc37-41f6c7a5c059 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:28.220738 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c8b8e9c-01a5-4cce-bc37-41f6c7a5c059 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:28.260403 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5c8b8e9c-01a5-4cce-bc37-41f6c7a5c059 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054863 Feb 21 04:16:28.267552 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 170/339] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:16:28 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 04:16:28.367851 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-05f1efb8-7c4d-4af1-8a8b-2586c9017e8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:28.376064 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-05f1efb8-7c4d-4af1-8a8b-2586c9017e8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.200519 Feb 21 04:16:28.377007 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 170/340] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:28 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:28.466640 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1819567352", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "networks": [{"uuid": "0e926c3e-9f0b-4575-b2e7-0a1f391618f8"}]}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:28.871162 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-74f69d47-81ea-4135-8f2d-39a570ed6314 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:28.871827 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-74f69d47-81ea-4135-8f2d-39a570ed6314 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:28.878146 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-74f69d47-81ea-4135-8f2d-39a570ed6314 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:28.878593 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-74f69d47-81ea-4135-8f2d-39a570ed6314 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:28.879398 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-74f69d47-81ea-4135-8f2d-39a570ed6314 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:28.880006 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-74f69d47-81ea-4135-8f2d-39a570ed6314 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:29.042962 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-74f69d47-81ea-4135-8f2d-39a570ed6314 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:29.051544 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-74f69d47-81ea-4135-8f2d-39a570ed6314 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1509 microversion: 2.1 time: 0.184095 Feb 21 04:16:29.052260 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 171/341] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:28 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:29.056725 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4ffbcf5c-6ce5-47f8-9037-20fd47086541 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:29.057335 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4ffbcf5c-6ce5-47f8-9037-20fd47086541 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:29.063720 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4ffbcf5c-6ce5-47f8-9037-20fd47086541 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:29.064171 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4ffbcf5c-6ce5-47f8-9037-20fd47086541 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:29.064991 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4ffbcf5c-6ce5-47f8-9037-20fd47086541 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:29.065433 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4ffbcf5c-6ce5-47f8-9037-20fd47086541 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:29.208378 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4ffbcf5c-6ce5-47f8-9037-20fd47086541 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:29.217282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4ffbcf5c-6ce5-47f8-9037-20fd47086541 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.163490 Feb 21 04:16:29.217852 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 172/342] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:29 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:29.394443 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6a597cdb-2c8f-4f31-814f-62b114e2b0ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:29.395056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6a597cdb-2c8f-4f31-814f-62b114e2b0ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:29.400998 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6a597cdb-2c8f-4f31-814f-62b114e2b0ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:29.401444 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6a597cdb-2c8f-4f31-814f-62b114e2b0ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:29.402219 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6a597cdb-2c8f-4f31-814f-62b114e2b0ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:29.402652 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6a597cdb-2c8f-4f31-814f-62b114e2b0ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:29.537664 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6a597cdb-2c8f-4f31-814f-62b114e2b0ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:29.544788 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6a597cdb-2c8f-4f31-814f-62b114e2b0ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.154046 Feb 21 04:16:29.545350 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 173/343] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:29 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:30.068890 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-cbf7598c-b063-462c-99f6-1ebc8eaf93b2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:30.069571 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-cbf7598c-b063-462c-99f6-1ebc8eaf93b2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:30.076068 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cbf7598c-b063-462c-99f6-1ebc8eaf93b2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:30.076574 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cbf7598c-b063-462c-99f6-1ebc8eaf93b2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:30.077566 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cbf7598c-b063-462c-99f6-1ebc8eaf93b2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:30.078050 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cbf7598c-b063-462c-99f6-1ebc8eaf93b2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:30.211456 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-cbf7598c-b063-462c-99f6-1ebc8eaf93b2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:30.219009 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-cbf7598c-b063-462c-99f6-1ebc8eaf93b2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1515 microversion: 2.1 time: 0.153712 Feb 21 04:16:30.219581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 174/344] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:30 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:30.234677 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-72f6dbad-3d24-41c7-a55a-463af315caec tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:30.235456 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-72f6dbad-3d24-41c7-a55a-463af315caec tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:30.241983 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-72f6dbad-3d24-41c7-a55a-463af315caec tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:30.242434 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-72f6dbad-3d24-41c7-a55a-463af315caec tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:30.243219 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-72f6dbad-3d24-41c7-a55a-463af315caec tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:30.243655 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-72f6dbad-3d24-41c7-a55a-463af315caec tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:30.387601 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-72f6dbad-3d24-41c7-a55a-463af315caec tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:30.395050 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-72f6dbad-3d24-41c7-a55a-463af315caec tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.164511 Feb 21 04:16:30.395629 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 175/345] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:30 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:30.561726 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-27175840-0246-4a7d-9f4d-a5a0cb7f25d6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:30.562464 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-27175840-0246-4a7d-9f4d-a5a0cb7f25d6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:30.569818 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-27175840-0246-4a7d-9f4d-a5a0cb7f25d6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:30.570268 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-27175840-0246-4a7d-9f4d-a5a0cb7f25d6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:30.571036 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-27175840-0246-4a7d-9f4d-a5a0cb7f25d6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:30.571466 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-27175840-0246-4a7d-9f4d-a5a0cb7f25d6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:30.706129 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-27175840-0246-4a7d-9f4d-a5a0cb7f25d6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:30.713407 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-27175840-0246-4a7d-9f4d-a5a0cb7f25d6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.155718 Feb 21 04:16:30.714009 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 176/346] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:30 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:31.412726 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-2120a59f-51bd-44e6-b88e-ea0596f78c5b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:31.413401 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-2120a59f-51bd-44e6-b88e-ea0596f78c5b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:31.419523 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2120a59f-51bd-44e6-b88e-ea0596f78c5b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:31.419967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2120a59f-51bd-44e6-b88e-ea0596f78c5b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:31.420762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2120a59f-51bd-44e6-b88e-ea0596f78c5b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:31.421196 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2120a59f-51bd-44e6-b88e-ea0596f78c5b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:31.552287 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-2120a59f-51bd-44e6-b88e-ea0596f78c5b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:31.559526 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-2120a59f-51bd-44e6-b88e-ea0596f78c5b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.150363 Feb 21 04:16:31.560764 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 177/347] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:31 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:31.730006 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-be342337-7f5a-40ea-8498-65fc61a8dd4a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:31.730621 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-be342337-7f5a-40ea-8498-65fc61a8dd4a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:31.736901 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-be342337-7f5a-40ea-8498-65fc61a8dd4a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:31.737355 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-be342337-7f5a-40ea-8498-65fc61a8dd4a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:31.738139 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-be342337-7f5a-40ea-8498-65fc61a8dd4a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:31.738577 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-be342337-7f5a-40ea-8498-65fc61a8dd4a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:31.869005 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-be342337-7f5a-40ea-8498-65fc61a8dd4a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:31.876735 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-be342337-7f5a-40ea-8498-65fc61a8dd4a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.150255 Feb 21 04:16:31.877294 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 178/348] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:31 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:32.577138 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9e7f48a5-d9b5-46eb-894d-1f3f4427d026 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:32.577752 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9e7f48a5-d9b5-46eb-894d-1f3f4427d026 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:32.584035 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e7f48a5-d9b5-46eb-894d-1f3f4427d026 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:32.584476 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e7f48a5-d9b5-46eb-894d-1f3f4427d026 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:32.585287 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e7f48a5-d9b5-46eb-894d-1f3f4427d026 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:32.585712 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e7f48a5-d9b5-46eb-894d-1f3f4427d026 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:32.719559 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9e7f48a5-d9b5-46eb-894d-1f3f4427d026 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:32.726766 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9e7f48a5-d9b5-46eb-894d-1f3f4427d026 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.153855 Feb 21 04:16:32.727327 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 179/349] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:32 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:32.897313 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9acabc10-921c-4441-ad8d-bf16f508b2d8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:32.897313 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9acabc10-921c-4441-ad8d-bf16f508b2d8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:32.900839 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9acabc10-921c-4441-ad8d-bf16f508b2d8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:32.901317 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9acabc10-921c-4441-ad8d-bf16f508b2d8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:32.902278 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9acabc10-921c-4441-ad8d-bf16f508b2d8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:32.902843 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9acabc10-921c-4441-ad8d-bf16f508b2d8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:33.035967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9acabc10-921c-4441-ad8d-bf16f508b2d8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:33.043085 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9acabc10-921c-4441-ad8d-bf16f508b2d8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.153273 Feb 21 04:16:33.043662 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 180/350] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:32 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:33.743107 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-26ba1d80-df6d-4e12-a2a7-229b87802c3b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:33.743778 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-26ba1d80-df6d-4e12-a2a7-229b87802c3b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:33.750095 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26ba1d80-df6d-4e12-a2a7-229b87802c3b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:33.750542 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26ba1d80-df6d-4e12-a2a7-229b87802c3b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:33.751313 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26ba1d80-df6d-4e12-a2a7-229b87802c3b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:33.751772 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26ba1d80-df6d-4e12-a2a7-229b87802c3b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:33.880867 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-26ba1d80-df6d-4e12-a2a7-229b87802c3b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:33.887889 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-26ba1d80-df6d-4e12-a2a7-229b87802c3b tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.148471 Feb 21 04:16:33.889016 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 181/351] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:33 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:34.059880 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9e38f5e0-cff5-4f4e-a957-7990f4db35a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:34.060484 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9e38f5e0-cff5-4f4e-a957-7990f4db35a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:34.066397 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e38f5e0-cff5-4f4e-a957-7990f4db35a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:34.066845 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e38f5e0-cff5-4f4e-a957-7990f4db35a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:34.067615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e38f5e0-cff5-4f4e-a957-7990f4db35a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:34.068045 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e38f5e0-cff5-4f4e-a957-7990f4db35a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:34.201785 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9e38f5e0-cff5-4f4e-a957-7990f4db35a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:34.209203 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9e38f5e0-cff5-4f4e-a957-7990f4db35a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.152898 Feb 21 04:16:34.209838 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 182/352] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:34 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:34.905242 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-bf27c722-07cf-4aae-826b-4d4dee22bc92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:34.905826 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-bf27c722-07cf-4aae-826b-4d4dee22bc92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:34.911864 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bf27c722-07cf-4aae-826b-4d4dee22bc92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:34.912318 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bf27c722-07cf-4aae-826b-4d4dee22bc92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:34.913120 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bf27c722-07cf-4aae-826b-4d4dee22bc92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:34.913555 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bf27c722-07cf-4aae-826b-4d4dee22bc92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:35.043801 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-bf27c722-07cf-4aae-826b-4d4dee22bc92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:35.051628 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-bf27c722-07cf-4aae-826b-4d4dee22bc92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.150755 Feb 21 04:16:35.052178 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 183/353] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:34 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:35.225083 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b6c05799-3b91-4aff-8191-31e48b931bf6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:35.225691 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b6c05799-3b91-4aff-8191-31e48b931bf6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:35.231316 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b6c05799-3b91-4aff-8191-31e48b931bf6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:35.232428 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b6c05799-3b91-4aff-8191-31e48b931bf6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:35.233244 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b6c05799-3b91-4aff-8191-31e48b931bf6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:35.233673 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b6c05799-3b91-4aff-8191-31e48b931bf6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:35.366043 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b6c05799-3b91-4aff-8191-31e48b931bf6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:35.373208 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b6c05799-3b91-4aff-8191-31e48b931bf6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.151611 Feb 21 04:16:35.373781 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 184/354] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:35 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:36.067648 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b27cea47-e5f0-4231-8073-85f2cae03b3f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:36.068285 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b27cea47-e5f0-4231-8073-85f2cae03b3f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:36.074509 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b27cea47-e5f0-4231-8073-85f2cae03b3f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:36.074960 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b27cea47-e5f0-4231-8073-85f2cae03b3f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:36.075734 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b27cea47-e5f0-4231-8073-85f2cae03b3f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:36.076167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b27cea47-e5f0-4231-8073-85f2cae03b3f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:36.204619 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b27cea47-e5f0-4231-8073-85f2cae03b3f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:36.211779 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b27cea47-e5f0-4231-8073-85f2cae03b3f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.147761 Feb 21 04:16:36.212338 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 185/355] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:36 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:36.389804 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-461c613f-7189-4748-8f8f-a0c8de82e114 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:36.390440 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-461c613f-7189-4748-8f8f-a0c8de82e114 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:36.396190 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-461c613f-7189-4748-8f8f-a0c8de82e114 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:36.396652 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-461c613f-7189-4748-8f8f-a0c8de82e114 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:36.397435 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-461c613f-7189-4748-8f8f-a0c8de82e114 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:36.397869 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-461c613f-7189-4748-8f8f-a0c8de82e114 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:36.526111 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-461c613f-7189-4748-8f8f-a0c8de82e114 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:36.534019 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-461c613f-7189-4748-8f8f-a0c8de82e114 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.147860 Feb 21 04:16:36.534615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 186/356] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:36 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:37.228238 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-be390d7a-70ed-4b12-93f3-3e1ffe1ac696 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:37.228942 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-be390d7a-70ed-4b12-93f3-3e1ffe1ac696 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:37.235234 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-be390d7a-70ed-4b12-93f3-3e1ffe1ac696 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:37.235714 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-be390d7a-70ed-4b12-93f3-3e1ffe1ac696 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:37.236475 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-be390d7a-70ed-4b12-93f3-3e1ffe1ac696 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:37.236932 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-be390d7a-70ed-4b12-93f3-3e1ffe1ac696 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:37.375153 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-be390d7a-70ed-4b12-93f3-3e1ffe1ac696 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:37.382249 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-be390d7a-70ed-4b12-93f3-3e1ffe1ac696 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.157648 Feb 21 04:16:37.382808 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 187/357] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:37 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:37.550968 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c500363f-f193-46e1-8dab-5314a6395806 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:37.551562 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c500363f-f193-46e1-8dab-5314a6395806 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:37.557399 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c500363f-f193-46e1-8dab-5314a6395806 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:37.557849 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c500363f-f193-46e1-8dab-5314a6395806 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:37.558628 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c500363f-f193-46e1-8dab-5314a6395806 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:37.559065 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c500363f-f193-46e1-8dab-5314a6395806 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:37.698511 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c500363f-f193-46e1-8dab-5314a6395806 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:37.705953 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c500363f-f193-46e1-8dab-5314a6395806 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1319 microversion: 2.1 time: 0.158764 Feb 21 04:16:37.706527 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 188/358] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:37 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:37.897664 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-b99fd78a-8ff3-49f1-a569-8b86cb83ae98 req-6241dbfb-0565-4f4b-890b-3d6d6972ee4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59362492-1a50-4bb3-a8a7-b29eb51489e4", "name": "network-vif-plugged", "status": "completed", "tag": "2f0ab78e-d156-44f8-a2e4-b409bf502408"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:37.899835 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:16:37.899835 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:16:37.908814 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-b99fd78a-8ff3-49f1-a569-8b86cb83ae98 req-6241dbfb-0565-4f4b-890b-3d6d6972ee4a service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:37.909280 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-b99fd78a-8ff3-49f1-a569-8b86cb83ae98 req-6241dbfb-0565-4f4b-890b-3d6d6972ee4a service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:37.921406 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-b99fd78a-8ff3-49f1-a569-8b86cb83ae98 req-6241dbfb-0565-4f4b-890b-3d6d6972ee4a service nova] Creating event network-vif-plugged:2f0ab78e-d156-44f8-a2e4-b409bf502408 for instance 59362492-1a50-4bb3-a8a7-b29eb51489e4 on hv-cinder-77398 Feb 21 04:16:37.926328 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-b99fd78a-8ff3-49f1-a569-8b86cb83ae98 req-6241dbfb-0565-4f4b-890b-3d6d6972ee4a service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032638 Feb 21 04:16:37.927075 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 189/359] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:16:38.400027 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-bbd7c069-fc34-40f9-8b48-6bf727fa91c5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:38.400876 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-bbd7c069-fc34-40f9-8b48-6bf727fa91c5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:38.407619 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bbd7c069-fc34-40f9-8b48-6bf727fa91c5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:38.408062 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bbd7c069-fc34-40f9-8b48-6bf727fa91c5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:38.408852 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bbd7c069-fc34-40f9-8b48-6bf727fa91c5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:38.409282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bbd7c069-fc34-40f9-8b48-6bf727fa91c5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:38.543745 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-bbd7c069-fc34-40f9-8b48-6bf727fa91c5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:38.551808 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-bbd7c069-fc34-40f9-8b48-6bf727fa91c5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.156172 Feb 21 04:16:38.552377 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 190/360] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:38 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:38.722762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e811604a-bba4-4e13-8ca2-f11e3d9dc684 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:38.723364 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e811604a-bba4-4e13-8ca2-f11e3d9dc684 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:38.729149 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e811604a-bba4-4e13-8ca2-f11e3d9dc684 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:38.729595 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e811604a-bba4-4e13-8ca2-f11e3d9dc684 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:38.730482 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e811604a-bba4-4e13-8ca2-f11e3d9dc684 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:38.730908 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e811604a-bba4-4e13-8ca2-f11e3d9dc684 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:38.865867 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e811604a-bba4-4e13-8ca2-f11e3d9dc684 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:38.873625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e811604a-bba4-4e13-8ca2-f11e3d9dc684 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1508 microversion: 2.1 time: 0.154243 Feb 21 04:16:38.874117 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 191/361] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:38 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:38.878375 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-329ce4bc-6efd-4fd0-b2d5-b5297d493782 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:38.879144 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-329ce4bc-6efd-4fd0-b2d5-b5297d493782 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:38.885685 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-329ce4bc-6efd-4fd0-b2d5-b5297d493782 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:38.886226 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-329ce4bc-6efd-4fd0-b2d5-b5297d493782 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:38.887029 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-329ce4bc-6efd-4fd0-b2d5-b5297d493782 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:38.887465 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-329ce4bc-6efd-4fd0-b2d5-b5297d493782 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:39.027619 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-329ce4bc-6efd-4fd0-b2d5-b5297d493782 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:39.035293 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-329ce4bc-6efd-4fd0-b2d5-b5297d493782 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1515 microversion: 2.1 time: 0.160248 Feb 21 04:16:39.035855 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 192/362] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:38 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:39.051329 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a1a9032f-f631-48ff-baa6-18cd78a31f18 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1278f265-415b-430a-878f-6fc33137ec08"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:39.052419 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a1a9032f-f631-48ff-baa6-18cd78a31f18 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:39.058222 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a1a9032f-f631-48ff-baa6-18cd78a31f18 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:39.058687 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a1a9032f-f631-48ff-baa6-18cd78a31f18 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:39.059434 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a1a9032f-f631-48ff-baa6-18cd78a31f18 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:39.059864 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a1a9032f-f631-48ff-baa6-18cd78a31f18 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:43.163778 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.network.neutron [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] validate_networks() for [('0e926c3e-9f0b-4575-b2e7-0a1f391618f8', None, None, None, None, None)] {{(pid=116570) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:16:43.567092 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Flavor limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:16:43.567573 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Image limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:16:43.568002 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Flavor pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:16:43.568414 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Image pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:16:43.568885 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:16:43.580536 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:43.581020 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:43.581836 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:43.582280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:43.600379 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Getting quotas for project a0b65910b0574d41970df84e6a1fdbba. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:16:43.605883 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Getting quotas for user 0eea911774944fa2bdb292719f9e2a54 and project a0b65910b0574d41970df84e6a1fdbba. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:16:43.618752 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Going to run 1 instances... {{(pid=116570) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:16:43.621163 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:16:43.667741 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d363473a-43c2-4097-b793-9fb541b843cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.204690 Feb 21 04:16:43.668301 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 171/363] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:16:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 15206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:16:43.672509 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-bcceecbd-d34b-4d6c-8a47-44cef079b166 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:43.673134 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-bcceecbd-d34b-4d6c-8a47-44cef079b166 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:43.679360 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bcceecbd-d34b-4d6c-8a47-44cef079b166 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:43.679799 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bcceecbd-d34b-4d6c-8a47-44cef079b166 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:43.680567 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bcceecbd-d34b-4d6c-8a47-44cef079b166 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:43.681031 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bcceecbd-d34b-4d6c-8a47-44cef079b166 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:43.831166 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-bcceecbd-d34b-4d6c-8a47-44cef079b166 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:43.838580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-bcceecbd-d34b-4d6c-8a47-44cef079b166 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.169239 Feb 21 04:16:43.839211 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 172/364] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:43 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:43.843506 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-099ffa9a-e061-4af9-ab6a-0f45e5a0d722 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:43.844161 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-099ffa9a-e061-4af9-ab6a-0f45e5a0d722 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:43.899439 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-099ffa9a-e061-4af9-ab6a-0f45e5a0d722 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:43.906224 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-099ffa9a-e061-4af9-ab6a-0f45e5a0d722 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1218 microversion: 2.1 time: 0.066050 Feb 21 04:16:43.906795 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 173/365] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:43 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:44.854873 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7001ecb4-f4bf-4bbd-9164-560872a5dd5e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:44.855429 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7001ecb4-f4bf-4bbd-9164-560872a5dd5e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:44.861720 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7001ecb4-f4bf-4bbd-9164-560872a5dd5e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:44.862166 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7001ecb4-f4bf-4bbd-9164-560872a5dd5e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:44.862937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7001ecb4-f4bf-4bbd-9164-560872a5dd5e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:44.863370 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7001ecb4-f4bf-4bbd-9164-560872a5dd5e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:44.994650 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7001ecb4-f4bf-4bbd-9164-560872a5dd5e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:45.001864 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7001ecb4-f4bf-4bbd-9164-560872a5dd5e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.150623 Feb 21 04:16:45.002433 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 174/366] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:44 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:45.006575 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-109762d7-9576-4392-899b-8ea01d91bde8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:45.007181 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-109762d7-9576-4392-899b-8ea01d91bde8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:45.012454 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-109762d7-9576-4392-899b-8ea01d91bde8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:45.012945 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-109762d7-9576-4392-899b-8ea01d91bde8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:45.013724 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-109762d7-9576-4392-899b-8ea01d91bde8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:45.014161 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-109762d7-9576-4392-899b-8ea01d91bde8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:45.071952 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-109762d7-9576-4392-899b-8ea01d91bde8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:45.078985 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-109762d7-9576-4392-899b-8ea01d91bde8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1222 microversion: 2.1 time: 0.075623 Feb 21 04:16:45.079546 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 175/367] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:45 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:46.018699 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b28b6463-d55b-4d48-9081-25625d531b54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:46.019347 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b28b6463-d55b-4d48-9081-25625d531b54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:46.025253 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b28b6463-d55b-4d48-9081-25625d531b54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:46.025702 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b28b6463-d55b-4d48-9081-25625d531b54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:46.026506 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b28b6463-d55b-4d48-9081-25625d531b54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:46.026940 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b28b6463-d55b-4d48-9081-25625d531b54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:46.158874 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b28b6463-d55b-4d48-9081-25625d531b54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:46.165853 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b28b6463-d55b-4d48-9081-25625d531b54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.150860 Feb 21 04:16:46.166415 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 176/368] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:46 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:46.170458 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f21f21e4-8ec9-4eaa-ad5f-454e69137167 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:46.171048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f21f21e4-8ec9-4eaa-ad5f-454e69137167 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:46.176438 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f21f21e4-8ec9-4eaa-ad5f-454e69137167 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:46.176931 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f21f21e4-8ec9-4eaa-ad5f-454e69137167 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:46.177746 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f21f21e4-8ec9-4eaa-ad5f-454e69137167 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:46.178182 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f21f21e4-8ec9-4eaa-ad5f-454e69137167 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:46.235226 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f21f21e4-8ec9-4eaa-ad5f-454e69137167 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:46.242212 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f21f21e4-8ec9-4eaa-ad5f-454e69137167 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1222 microversion: 2.1 time: 0.074882 Feb 21 04:16:46.242776 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 177/369] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:46 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:47.181591 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-15644811-9e6e-4a3f-9d3c-9ee43c5624f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:47.182250 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-15644811-9e6e-4a3f-9d3c-9ee43c5624f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:47.188598 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-15644811-9e6e-4a3f-9d3c-9ee43c5624f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:47.189069 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-15644811-9e6e-4a3f-9d3c-9ee43c5624f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:47.189870 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-15644811-9e6e-4a3f-9d3c-9ee43c5624f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:47.190304 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-15644811-9e6e-4a3f-9d3c-9ee43c5624f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:47.335389 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-15644811-9e6e-4a3f-9d3c-9ee43c5624f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:47.343030 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-15644811-9e6e-4a3f-9d3c-9ee43c5624f2 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.165008 Feb 21 04:16:47.343977 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 178/370] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:47 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:47.348815 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fac52802-a4b4-4769-a9d1-065802402e2e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:47.349415 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fac52802-a4b4-4769-a9d1-065802402e2e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:47.354994 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fac52802-a4b4-4769-a9d1-065802402e2e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:47.355435 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fac52802-a4b4-4769-a9d1-065802402e2e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:47.357328 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fac52802-a4b4-4769-a9d1-065802402e2e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:47.357805 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fac52802-a4b4-4769-a9d1-065802402e2e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:47.382132 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a1a9032f-f631-48ff-baa6-18cd78a31f18 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "POST /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.334170 Feb 21 04:16:47.383405 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 193/371] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:16:39 2022] POST /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 194 bytes in 8336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:16:47.444019 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fac52802-a4b4-4769-a9d1-065802402e2e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:47.456734 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fac52802-a4b4-4769-a9d1-065802402e2e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1214 microversion: 2.1 time: 0.111120 Feb 21 04:16:47.457564 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 179/372] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:47 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:48.362084 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7ef16e3f-5364-4e7e-a530-c138654fddbb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:48.362810 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7ef16e3f-5364-4e7e-a530-c138654fddbb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:48.369461 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ef16e3f-5364-4e7e-a530-c138654fddbb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:48.369907 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ef16e3f-5364-4e7e-a530-c138654fddbb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:48.370669 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ef16e3f-5364-4e7e-a530-c138654fddbb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:48.371099 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ef16e3f-5364-4e7e-a530-c138654fddbb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:48.474368 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-95387917-d46a-4714-bbc0-14b04eabaf2c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:48.475770 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-95387917-d46a-4714-bbc0-14b04eabaf2c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:48.482349 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-95387917-d46a-4714-bbc0-14b04eabaf2c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:48.482969 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-95387917-d46a-4714-bbc0-14b04eabaf2c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:48.483926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-95387917-d46a-4714-bbc0-14b04eabaf2c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:48.484524 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-95387917-d46a-4714-bbc0-14b04eabaf2c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:48.522483 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7ef16e3f-5364-4e7e-a530-c138654fddbb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:48.539110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7ef16e3f-5364-4e7e-a530-c138654fddbb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1359 microversion: 2.1 time: 0.181995 Feb 21 04:16:48.539715 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 194/373] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:48 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:48.586445 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-95387917-d46a-4714-bbc0-14b04eabaf2c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:48.593765 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-95387917-d46a-4714-bbc0-14b04eabaf2c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1270 microversion: 2.1 time: 0.123028 Feb 21 04:16:48.595582 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 180/374] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:48 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:49.555145 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-87eaa568-796f-453d-b33d-cf418a13fbab tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:49.555884 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-87eaa568-796f-453d-b33d-cf418a13fbab tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:49.562221 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-87eaa568-796f-453d-b33d-cf418a13fbab tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:49.562796 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-87eaa568-796f-453d-b33d-cf418a13fbab tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:49.563720 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-87eaa568-796f-453d-b33d-cf418a13fbab tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:49.564284 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-87eaa568-796f-453d-b33d-cf418a13fbab tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:49.613078 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d1f8e333-5ab7-446d-a717-f1d6ee18eba6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:49.613683 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d1f8e333-5ab7-446d-a717-f1d6ee18eba6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:49.620423 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d1f8e333-5ab7-446d-a717-f1d6ee18eba6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:49.620894 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d1f8e333-5ab7-446d-a717-f1d6ee18eba6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:49.625673 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d1f8e333-5ab7-446d-a717-f1d6ee18eba6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:49.626141 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d1f8e333-5ab7-446d-a717-f1d6ee18eba6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:49.857112 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-87eaa568-796f-453d-b33d-cf418a13fbab tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:49.867111 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-87eaa568-796f-453d-b33d-cf418a13fbab tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1549 microversion: 2.1 time: 0.315496 Feb 21 04:16:49.878273 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 195/375] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:49 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1549 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:49.883049 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-44f194e8-a498-471a-bb46-4ae3c2d99780 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:49.883841 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-44f194e8-a498-471a-bb46-4ae3c2d99780 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:49.889772 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-44f194e8-a498-471a-bb46-4ae3c2d99780 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:49.890218 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-44f194e8-a498-471a-bb46-4ae3c2d99780 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:49.891533 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-44f194e8-a498-471a-bb46-4ae3c2d99780 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:49.891967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-44f194e8-a498-471a-bb46-4ae3c2d99780 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:49.945016 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d1f8e333-5ab7-446d-a717-f1d6ee18eba6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:49.952264 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d1f8e333-5ab7-446d-a717-f1d6ee18eba6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.344908 Feb 21 04:16:49.952943 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 181/376] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:49 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:50.109314 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-44f194e8-a498-471a-bb46-4ae3c2d99780 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:50.116465 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-44f194e8-a498-471a-bb46-4ae3c2d99780 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1549 microversion: 2.1 time: 0.236830 Feb 21 04:16:50.117082 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 196/377] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:49 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1549 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:50.131862 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ed962441-55e6-4ca9-810a-eed7dc1167cb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:50.135272 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:16:50.135272 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:16:50.136271 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ed962441-55e6-4ca9-810a-eed7dc1167cb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:50.136965 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ed962441-55e6-4ca9-810a-eed7dc1167cb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Searching by: {'deleted': False, 'project_id': 'aa514a3d1a314decab32eefda5e67939'} {{(pid=116570) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 21 04:16:50.145460 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-b8539dab-b475-47e6-8fc4-b13b4ab6c007 req-ddfc0d7f-fd89-4d0a-82d7-a95281bc9030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38295c86-79cf-4f53-828c-2f9e5350d0c8", "tag": "202428dd-b415-43d4-9158-7c34074b9adf"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:50.147001 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:16:50.147001 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:16:50.153193 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ed962441-55e6-4ca9-810a-eed7dc1167cb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:50.153615 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ed962441-55e6-4ca9-810a-eed7dc1167cb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:50.154637 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ed962441-55e6-4ca9-810a-eed7dc1167cb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:50.155073 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ed962441-55e6-4ca9-810a-eed7dc1167cb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:50.155624 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-b8539dab-b475-47e6-8fc4-b13b4ab6c007 req-ddfc0d7f-fd89-4d0a-82d7-a95281bc9030 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:50.156241 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-b8539dab-b475-47e6-8fc4-b13b4ab6c007 req-ddfc0d7f-fd89-4d0a-82d7-a95281bc9030 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:50.169966 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-b8539dab-b475-47e6-8fc4-b13b4ab6c007 req-ddfc0d7f-fd89-4d0a-82d7-a95281bc9030 service nova] Creating event network-changed:202428dd-b415-43d4-9158-7c34074b9adf for instance 38295c86-79cf-4f53-828c-2f9e5350d0c8 on hv-cinder-77398 Feb 21 04:16:50.175311 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-b8539dab-b475-47e6-8fc4-b13b4ab6c007 req-ddfc0d7f-fd89-4d0a-82d7-a95281bc9030 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033764 Feb 21 04:16:50.176277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 197/378] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:16:50.254925 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.multi_cell_list [None req-ed962441-55e6-4ca9-810a-eed7dc1167cb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 21 04:16:50.351228 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ed962441-55e6-4ca9-810a-eed7dc1167cb tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.222743 Feb 21 04:16:50.356842 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 182/379] 10.222.0.10 () {58 vars in 1124 bytes} [Mon Feb 21 04:16:50 2022] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:16:50.363506 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5c8c8b17-b5df-4698-801a-c9199272225a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:50.364299 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5c8c8b17-b5df-4698-801a-c9199272225a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:50.371764 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5c8c8b17-b5df-4698-801a-c9199272225a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:50.372261 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5c8c8b17-b5df-4698-801a-c9199272225a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:50.373136 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5c8c8b17-b5df-4698-801a-c9199272225a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:50.373562 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5c8c8b17-b5df-4698-801a-c9199272225a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:50.719944 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5c8c8b17-b5df-4698-801a-c9199272225a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:50.727222 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5c8c8b17-b5df-4698-801a-c9199272225a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1549 microversion: 2.1 time: 0.368304 Feb 21 04:16:50.727870 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 198/380] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:50 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1549 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:16:50.968763 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0d832f5c-804f-4f37-a561-f327d860b499 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:50.970595 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0d832f5c-804f-4f37-a561-f327d860b499 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:50.976933 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0d832f5c-804f-4f37-a561-f327d860b499 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:50.977775 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0d832f5c-804f-4f37-a561-f327d860b499 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:50.978711 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0d832f5c-804f-4f37-a561-f327d860b499 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:50.979452 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0d832f5c-804f-4f37-a561-f327d860b499 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:51.223813 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0d832f5c-804f-4f37-a561-f327d860b499 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:51.231307 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0d832f5c-804f-4f37-a561-f327d860b499 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.266135 Feb 21 04:16:51.231876 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 183/381] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:50 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:52.246938 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-738f2c96-e0f7-458c-84ad-92b2530b9ca5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:52.247547 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-738f2c96-e0f7-458c-84ad-92b2530b9ca5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:52.254953 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-738f2c96-e0f7-458c-84ad-92b2530b9ca5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:52.255411 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-738f2c96-e0f7-458c-84ad-92b2530b9ca5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:52.256190 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-738f2c96-e0f7-458c-84ad-92b2530b9ca5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:52.256616 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ede6afbc-dee7-4d86-a62f-68fad7f3cfef tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c741b3b9-eaca-4db8-8fcb-21fc270d557f"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:16:52.257067 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-738f2c96-e0f7-458c-84ad-92b2530b9ca5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:52.257689 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ede6afbc-dee7-4d86-a62f-68fad7f3cfef tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:52.263459 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ede6afbc-dee7-4d86-a62f-68fad7f3cfef tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:52.263903 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ede6afbc-dee7-4d86-a62f-68fad7f3cfef tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:52.264703 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ede6afbc-dee7-4d86-a62f-68fad7f3cfef tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:52.265167 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ede6afbc-dee7-4d86-a62f-68fad7f3cfef tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:52.397626 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-738f2c96-e0f7-458c-84ad-92b2530b9ca5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:52.406722 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-738f2c96-e0f7-458c-84ad-92b2530b9ca5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.163357 Feb 21 04:16:52.407673 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 199/382] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:52 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:52.538129 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ede6afbc-dee7-4d86-a62f-68fad7f3cfef tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "POST /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285033 Feb 21 04:16:52.538921 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 184/383] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:16:52 2022] POST /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:16:53.423142 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a957829f-a530-45ea-a3e9-6ecc8b3e3f25 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:53.423739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a957829f-a530-45ea-a3e9-6ecc8b3e3f25 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:53.429976 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a957829f-a530-45ea-a3e9-6ecc8b3e3f25 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:53.430424 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a957829f-a530-45ea-a3e9-6ecc8b3e3f25 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:53.431186 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a957829f-a530-45ea-a3e9-6ecc8b3e3f25 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:53.431612 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a957829f-a530-45ea-a3e9-6ecc8b3e3f25 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:53.571954 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a957829f-a530-45ea-a3e9-6ecc8b3e3f25 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:53.579824 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a957829f-a530-45ea-a3e9-6ecc8b3e3f25 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.160327 Feb 21 04:16:53.588919 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 200/384] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:53 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:54.598742 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ba508f79-9eb0-47e8-871e-18848e90856b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:54.599442 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ba508f79-9eb0-47e8-871e-18848e90856b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:54.605811 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ba508f79-9eb0-47e8-871e-18848e90856b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:54.606273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ba508f79-9eb0-47e8-871e-18848e90856b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:54.607086 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ba508f79-9eb0-47e8-871e-18848e90856b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:54.607521 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ba508f79-9eb0-47e8-871e-18848e90856b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:54.746154 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ba508f79-9eb0-47e8-871e-18848e90856b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:54.753777 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ba508f79-9eb0-47e8-871e-18848e90856b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.161109 Feb 21 04:16:54.754355 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 185/385] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:54 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:55.771172 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-da1d67ae-5497-4279-a39c-9792bcccbf31 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:55.771789 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-da1d67ae-5497-4279-a39c-9792bcccbf31 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:55.777580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-da1d67ae-5497-4279-a39c-9792bcccbf31 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:55.778275 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-da1d67ae-5497-4279-a39c-9792bcccbf31 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:55.779042 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-da1d67ae-5497-4279-a39c-9792bcccbf31 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:55.779470 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-da1d67ae-5497-4279-a39c-9792bcccbf31 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:55.920145 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-da1d67ae-5497-4279-a39c-9792bcccbf31 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:55.927569 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-da1d67ae-5497-4279-a39c-9792bcccbf31 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.160522 Feb 21 04:16:55.928130 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 201/386] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:55 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:56.944094 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b2a2a57c-db9b-4799-8e90-fffd3ae8a50f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:56.944828 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b2a2a57c-db9b-4799-8e90-fffd3ae8a50f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:56.951208 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b2a2a57c-db9b-4799-8e90-fffd3ae8a50f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:56.951731 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b2a2a57c-db9b-4799-8e90-fffd3ae8a50f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:56.952576 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b2a2a57c-db9b-4799-8e90-fffd3ae8a50f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:56.953100 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b2a2a57c-db9b-4799-8e90-fffd3ae8a50f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:57.087198 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b2a2a57c-db9b-4799-8e90-fffd3ae8a50f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:57.094261 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b2a2a57c-db9b-4799-8e90-fffd3ae8a50f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.153809 Feb 21 04:16:57.094823 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 186/387] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:56 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:58.111195 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f89185bf-60e3-4b5e-98ce-b46a9115a44e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:58.111842 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f89185bf-60e3-4b5e-98ce-b46a9115a44e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:58.118181 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f89185bf-60e3-4b5e-98ce-b46a9115a44e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:58.118630 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f89185bf-60e3-4b5e-98ce-b46a9115a44e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:58.120048 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f89185bf-60e3-4b5e-98ce-b46a9115a44e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:58.120048 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f89185bf-60e3-4b5e-98ce-b46a9115a44e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:58.254125 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-f89185bf-60e3-4b5e-98ce-b46a9115a44e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:58.261433 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f89185bf-60e3-4b5e-98ce-b46a9115a44e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.154535 Feb 21 04:16:58.261996 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 202/388] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:58 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:16:59.280356 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2ebddbfa-8b61-49df-89ad-e79b1fd0a474 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:16:59.280933 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2ebddbfa-8b61-49df-89ad-e79b1fd0a474 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:16:59.287534 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2ebddbfa-8b61-49df-89ad-e79b1fd0a474 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:59.287977 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2ebddbfa-8b61-49df-89ad-e79b1fd0a474 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:59.288837 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2ebddbfa-8b61-49df-89ad-e79b1fd0a474 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:16:59.289491 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2ebddbfa-8b61-49df-89ad-e79b1fd0a474 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:16:59.423514 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2ebddbfa-8b61-49df-89ad-e79b1fd0a474 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:16:59.430785 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2ebddbfa-8b61-49df-89ad-e79b1fd0a474 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.154290 Feb 21 04:16:59.431356 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 187/389] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:16:59 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:00.446976 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9663ae6a-1d35-4fa0-9492-1abf45470e00 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:00.447589 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9663ae6a-1d35-4fa0-9492-1abf45470e00 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:00.453718 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9663ae6a-1d35-4fa0-9492-1abf45470e00 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:00.454163 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9663ae6a-1d35-4fa0-9492-1abf45470e00 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:00.454933 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9663ae6a-1d35-4fa0-9492-1abf45470e00 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:00.455360 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9663ae6a-1d35-4fa0-9492-1abf45470e00 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:00.582519 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9663ae6a-1d35-4fa0-9492-1abf45470e00 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:00.589672 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9663ae6a-1d35-4fa0-9492-1abf45470e00 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.146241 Feb 21 04:17:00.590236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 203/390] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:00 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:01.605065 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f75ddafb-22a8-4e94-97f3-64ecd4f5ae97 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:01.605675 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f75ddafb-22a8-4e94-97f3-64ecd4f5ae97 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:01.611787 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f75ddafb-22a8-4e94-97f3-64ecd4f5ae97 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:01.612230 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f75ddafb-22a8-4e94-97f3-64ecd4f5ae97 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:01.613027 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f75ddafb-22a8-4e94-97f3-64ecd4f5ae97 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:01.613463 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f75ddafb-22a8-4e94-97f3-64ecd4f5ae97 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:01.740367 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f75ddafb-22a8-4e94-97f3-64ecd4f5ae97 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:01.747513 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f75ddafb-22a8-4e94-97f3-64ecd4f5ae97 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.146083 Feb 21 04:17:01.748068 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 188/391] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:01 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:02.764364 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7bc984a8-3eb0-4d20-8a46-7f62abf60d98 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:02.765003 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7bc984a8-3eb0-4d20-8a46-7f62abf60d98 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:02.771684 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7bc984a8-3eb0-4d20-8a46-7f62abf60d98 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:02.772179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7bc984a8-3eb0-4d20-8a46-7f62abf60d98 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:02.773002 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7bc984a8-3eb0-4d20-8a46-7f62abf60d98 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:02.773430 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7bc984a8-3eb0-4d20-8a46-7f62abf60d98 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:02.917390 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7bc984a8-3eb0-4d20-8a46-7f62abf60d98 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:02.924801 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7bc984a8-3eb0-4d20-8a46-7f62abf60d98 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.163907 Feb 21 04:17:02.925338 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 204/392] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:02 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:03.341894 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9a60a63c-7474-4abb-80dd-1ad44c645ccd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:03.343015 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9a60a63c-7474-4abb-80dd-1ad44c645ccd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:03.349454 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9a60a63c-7474-4abb-80dd-1ad44c645ccd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:03.349967 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9a60a63c-7474-4abb-80dd-1ad44c645ccd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:03.351062 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9a60a63c-7474-4abb-80dd-1ad44c645ccd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:03.351578 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9a60a63c-7474-4abb-80dd-1ad44c645ccd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:03.385190 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-9a60a63c-7474-4abb-80dd-1ad44c645ccd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lazy-loading 'flavor' on Instance uuid 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:17:03.614143 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9a60a63c-7474-4abb-80dd-1ad44c645ccd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "POST /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/action" status: 200 len: 32 microversion: 2.1 time: 0.275960 Feb 21 04:17:03.614758 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 189/393] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:17:03 2022] POST /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 04:17:03.623274 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-19507de7-54fb-42f4-ba3c-1290f2002186 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:03.623990 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-19507de7-54fb-42f4-ba3c-1290f2002186 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:03.630462 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-19507de7-54fb-42f4-ba3c-1290f2002186 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:03.630989 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-19507de7-54fb-42f4-ba3c-1290f2002186 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:03.631812 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-19507de7-54fb-42f4-ba3c-1290f2002186 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:03.632275 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-19507de7-54fb-42f4-ba3c-1290f2002186 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:03.842118 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-19507de7-54fb-42f4-ba3c-1290f2002186 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:03.851270 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-19507de7-54fb-42f4-ba3c-1290f2002186 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.231474 Feb 21 04:17:03.852533 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 205/394] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:03 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:03.941648 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6b4a8c6e-894d-4e9b-817c-2dfc88deb04d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:03.942344 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6b4a8c6e-894d-4e9b-817c-2dfc88deb04d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:03.949375 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6b4a8c6e-894d-4e9b-817c-2dfc88deb04d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:03.950083 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6b4a8c6e-894d-4e9b-817c-2dfc88deb04d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:03.951078 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6b4a8c6e-894d-4e9b-817c-2dfc88deb04d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:03.951727 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6b4a8c6e-894d-4e9b-817c-2dfc88deb04d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:04.174773 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6b4a8c6e-894d-4e9b-817c-2dfc88deb04d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:04.182645 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6b4a8c6e-894d-4e9b-817c-2dfc88deb04d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.244939 Feb 21 04:17:04.183260 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 190/395] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:03 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:04.868199 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fde51993-9f2a-4dae-b6c4-62f97faa3a2c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:04.868833 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fde51993-9f2a-4dae-b6c4-62f97faa3a2c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:04.875171 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fde51993-9f2a-4dae-b6c4-62f97faa3a2c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:04.875639 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fde51993-9f2a-4dae-b6c4-62f97faa3a2c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:04.876439 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fde51993-9f2a-4dae-b6c4-62f97faa3a2c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:04.876899 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fde51993-9f2a-4dae-b6c4-62f97faa3a2c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:05.009022 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-fde51993-9f2a-4dae-b6c4-62f97faa3a2c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:05.017436 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fde51993-9f2a-4dae-b6c4-62f97faa3a2c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.152967 Feb 21 04:17:05.018126 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 206/396] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:04 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:05.199871 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f4b3bf2b-06c9-499f-ae62-4a14ce9c7c75 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:05.200470 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f4b3bf2b-06c9-499f-ae62-4a14ce9c7c75 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:05.207348 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f4b3bf2b-06c9-499f-ae62-4a14ce9c7c75 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:05.207878 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f4b3bf2b-06c9-499f-ae62-4a14ce9c7c75 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:05.208756 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f4b3bf2b-06c9-499f-ae62-4a14ce9c7c75 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:05.209288 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f4b3bf2b-06c9-499f-ae62-4a14ce9c7c75 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:05.343245 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f4b3bf2b-06c9-499f-ae62-4a14ce9c7c75 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:05.351516 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f4b3bf2b-06c9-499f-ae62-4a14ce9c7c75 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.155150 Feb 21 04:17:05.352087 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 191/397] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:05 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:06.036787 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3ea66bd9-e444-4ec5-98a5-377131cab5cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:06.037402 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3ea66bd9-e444-4ec5-98a5-377131cab5cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:06.043608 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3ea66bd9-e444-4ec5-98a5-377131cab5cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:06.044048 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3ea66bd9-e444-4ec5-98a5-377131cab5cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:06.044845 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3ea66bd9-e444-4ec5-98a5-377131cab5cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:06.045270 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3ea66bd9-e444-4ec5-98a5-377131cab5cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:06.180380 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-3ea66bd9-e444-4ec5-98a5-377131cab5cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:06.188225 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3ea66bd9-e444-4ec5-98a5-377131cab5cd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.154990 Feb 21 04:17:06.188823 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 207/398] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:06 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:06.368447 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-97ae4776-a4ac-4d6f-baef-4a92ccd1b4c1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:06.369036 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-97ae4776-a4ac-4d6f-baef-4a92ccd1b4c1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:06.375297 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-97ae4776-a4ac-4d6f-baef-4a92ccd1b4c1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:06.375779 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-97ae4776-a4ac-4d6f-baef-4a92ccd1b4c1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:06.376562 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-97ae4776-a4ac-4d6f-baef-4a92ccd1b4c1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:06.377024 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-97ae4776-a4ac-4d6f-baef-4a92ccd1b4c1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:06.506765 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-97ae4776-a4ac-4d6f-baef-4a92ccd1b4c1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:06.514008 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-97ae4776-a4ac-4d6f-baef-4a92ccd1b4c1 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.149451 Feb 21 04:17:06.514787 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 192/399] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:06 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:07.205594 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8705d3c5-aa35-4662-8eeb-a8f6830f2728 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:07.206239 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-8705d3c5-aa35-4662-8eeb-a8f6830f2728 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:07.212620 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8705d3c5-aa35-4662-8eeb-a8f6830f2728 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:07.213108 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8705d3c5-aa35-4662-8eeb-a8f6830f2728 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:07.214173 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8705d3c5-aa35-4662-8eeb-a8f6830f2728 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:07.214334 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8705d3c5-aa35-4662-8eeb-a8f6830f2728 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:07.372590 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8705d3c5-aa35-4662-8eeb-a8f6830f2728 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:07.381018 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-8705d3c5-aa35-4662-8eeb-a8f6830f2728 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.179235 Feb 21 04:17:07.381598 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 208/400] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:07 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:07.531152 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a0e37f34-90e0-4c64-9871-24f9dd9538a4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:07.532598 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a0e37f34-90e0-4c64-9871-24f9dd9538a4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:07.538503 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a0e37f34-90e0-4c64-9871-24f9dd9538a4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:07.539030 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a0e37f34-90e0-4c64-9871-24f9dd9538a4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:07.539881 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a0e37f34-90e0-4c64-9871-24f9dd9538a4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:07.540389 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a0e37f34-90e0-4c64-9871-24f9dd9538a4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:07.685565 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a0e37f34-90e0-4c64-9871-24f9dd9538a4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:07.690119 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a0e37f34-90e0-4c64-9871-24f9dd9538a4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.163454 Feb 21 04:17:07.690788 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 193/401] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:07 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:08.399382 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e832501a-bcf2-4fae-aef5-b1a0b258378e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:08.401296 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e832501a-bcf2-4fae-aef5-b1a0b258378e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:08.408459 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e832501a-bcf2-4fae-aef5-b1a0b258378e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:08.408935 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e832501a-bcf2-4fae-aef5-b1a0b258378e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:08.409714 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e832501a-bcf2-4fae-aef5-b1a0b258378e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:08.410144 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e832501a-bcf2-4fae-aef5-b1a0b258378e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:08.557734 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e832501a-bcf2-4fae-aef5-b1a0b258378e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:08.565588 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e832501a-bcf2-4fae-aef5-b1a0b258378e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.171354 Feb 21 04:17:08.566092 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 209/402] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:08 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:08.707178 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8c1fec29-3f55-44bc-9f73-4c6147fd610c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:08.707936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8c1fec29-3f55-44bc-9f73-4c6147fd610c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:08.714629 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8c1fec29-3f55-44bc-9f73-4c6147fd610c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:08.715083 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8c1fec29-3f55-44bc-9f73-4c6147fd610c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:08.715927 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8c1fec29-3f55-44bc-9f73-4c6147fd610c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:08.716360 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8c1fec29-3f55-44bc-9f73-4c6147fd610c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:08.883557 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8c1fec29-3f55-44bc-9f73-4c6147fd610c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:08.897623 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8c1fec29-3f55-44bc-9f73-4c6147fd610c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.194924 Feb 21 04:17:08.899267 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 194/403] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:08 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:09.581967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c2c7e8d9-cf20-4c9e-aab7-adba10ceb14e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:09.583238 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c2c7e8d9-cf20-4c9e-aab7-adba10ceb14e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:09.589497 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c2c7e8d9-cf20-4c9e-aab7-adba10ceb14e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:09.590050 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c2c7e8d9-cf20-4c9e-aab7-adba10ceb14e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:09.590823 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c2c7e8d9-cf20-4c9e-aab7-adba10ceb14e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:09.591282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c2c7e8d9-cf20-4c9e-aab7-adba10ceb14e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:09.727274 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c2c7e8d9-cf20-4c9e-aab7-adba10ceb14e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:09.735523 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c2c7e8d9-cf20-4c9e-aab7-adba10ceb14e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.156570 Feb 21 04:17:09.736090 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 210/404] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:09 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:09.918665 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5c291e1a-6253-4f68-b50d-5978738ae7ae tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:09.919307 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5c291e1a-6253-4f68-b50d-5978738ae7ae tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:09.926062 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c291e1a-6253-4f68-b50d-5978738ae7ae tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:09.926522 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c291e1a-6253-4f68-b50d-5978738ae7ae tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:09.927301 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c291e1a-6253-4f68-b50d-5978738ae7ae tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:09.927801 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c291e1a-6253-4f68-b50d-5978738ae7ae tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:10.064374 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5c291e1a-6253-4f68-b50d-5978738ae7ae tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:10.071519 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5c291e1a-6253-4f68-b50d-5978738ae7ae tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.156446 Feb 21 04:17:10.072088 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 195/405] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:09 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:10.751741 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-039940fa-e231-4d00-b66d-f9970a175578 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:10.752377 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-039940fa-e231-4d00-b66d-f9970a175578 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:10.758650 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-039940fa-e231-4d00-b66d-f9970a175578 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:10.759090 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-039940fa-e231-4d00-b66d-f9970a175578 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:10.759888 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-039940fa-e231-4d00-b66d-f9970a175578 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:10.760316 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-039940fa-e231-4d00-b66d-f9970a175578 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:11.009920 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-039940fa-e231-4d00-b66d-f9970a175578 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:11.018100 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-039940fa-e231-4d00-b66d-f9970a175578 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.270049 Feb 21 04:17:11.018667 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 211/406] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:10 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:11.087989 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1cfc9ce3-3a12-4ff7-a561-624a0ad5e18b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:11.088593 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1cfc9ce3-3a12-4ff7-a561-624a0ad5e18b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:11.097828 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1cfc9ce3-3a12-4ff7-a561-624a0ad5e18b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:11.098779 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1cfc9ce3-3a12-4ff7-a561-624a0ad5e18b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:11.099583 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1cfc9ce3-3a12-4ff7-a561-624a0ad5e18b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:11.100016 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1cfc9ce3-3a12-4ff7-a561-624a0ad5e18b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:11.313343 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1cfc9ce3-3a12-4ff7-a561-624a0ad5e18b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:11.320619 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1cfc9ce3-3a12-4ff7-a561-624a0ad5e18b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.236247 Feb 21 04:17:11.328167 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 196/407] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:11 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:12.036747 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7b8b668f-a88f-4cf7-875c-94584435fee5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:12.037167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-9e01eb6d-8636-40cf-9e6f-85641a00c381 req-9c601130-9e96-40f1-b792-15ec9239e906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38295c86-79cf-4f53-828c-2f9e5350d0c8", "name": "network-vif-plugged", "status": "completed", "tag": "202428dd-b415-43d4-9158-7c34074b9adf"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:12.039416 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7b8b668f-a88f-4cf7-875c-94584435fee5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:12.041075 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:17:12.041075 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:17:12.054261 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7b8b668f-a88f-4cf7-875c-94584435fee5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:12.055573 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7b8b668f-a88f-4cf7-875c-94584435fee5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:12.057144 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7b8b668f-a88f-4cf7-875c-94584435fee5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:12.059098 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-9e01eb6d-8636-40cf-9e6f-85641a00c381 req-9c601130-9e96-40f1-b792-15ec9239e906 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:12.059805 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7b8b668f-a88f-4cf7-875c-94584435fee5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:12.062789 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-9e01eb6d-8636-40cf-9e6f-85641a00c381 req-9c601130-9e96-40f1-b792-15ec9239e906 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:12.083637 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-9e01eb6d-8636-40cf-9e6f-85641a00c381 req-9c601130-9e96-40f1-b792-15ec9239e906 service nova] Creating event network-vif-plugged:202428dd-b415-43d4-9158-7c34074b9adf for instance 38295c86-79cf-4f53-828c-2f9e5350d0c8 on hv-cinder-77398 Feb 21 04:17:12.095100 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-9e01eb6d-8636-40cf-9e6f-85641a00c381 req-9c601130-9e96-40f1-b792-15ec9239e906 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068146 Feb 21 04:17:12.095751 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 212/408] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:12.234471 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7b8b668f-a88f-4cf7-875c-94584435fee5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:12.243399 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7b8b668f-a88f-4cf7-875c-94584435fee5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.212000 Feb 21 04:17:12.244083 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 197/409] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:12 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:12.338799 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4b476627-b0bd-49c8-83f4-dfbe284fd116 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:12.339578 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4b476627-b0bd-49c8-83f4-dfbe284fd116 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:12.346370 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4b476627-b0bd-49c8-83f4-dfbe284fd116 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:12.346894 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4b476627-b0bd-49c8-83f4-dfbe284fd116 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:12.347765 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4b476627-b0bd-49c8-83f4-dfbe284fd116 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:12.348273 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4b476627-b0bd-49c8-83f4-dfbe284fd116 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:12.482737 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4b476627-b0bd-49c8-83f4-dfbe284fd116 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:12.491461 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4b476627-b0bd-49c8-83f4-dfbe284fd116 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.156557 Feb 21 04:17:12.492093 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 213/410] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:12 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:12.667722 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-86ecdf9b-26c2-4c80-a236-fa3c3dfb6c22 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:12.668326 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-86ecdf9b-26c2-4c80-a236-fa3c3dfb6c22 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:12.674541 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-86ecdf9b-26c2-4c80-a236-fa3c3dfb6c22 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:12.674984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-86ecdf9b-26c2-4c80-a236-fa3c3dfb6c22 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:12.675740 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-86ecdf9b-26c2-4c80-a236-fa3c3dfb6c22 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:12.676168 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-86ecdf9b-26c2-4c80-a236-fa3c3dfb6c22 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:12.809695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-86ecdf9b-26c2-4c80-a236-fa3c3dfb6c22 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:12.817346 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-86ecdf9b-26c2-4c80-a236-fa3c3dfb6c22 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1595 microversion: 2.1 time: 0.153244 Feb 21 04:17:12.817921 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 198/411] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:12 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:13.260816 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5d9dff04-cc7f-464b-bfb2-5a90b9ac6f2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:13.261451 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5d9dff04-cc7f-464b-bfb2-5a90b9ac6f2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:13.267793 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5d9dff04-cc7f-464b-bfb2-5a90b9ac6f2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:13.268236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5d9dff04-cc7f-464b-bfb2-5a90b9ac6f2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:13.269053 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5d9dff04-cc7f-464b-bfb2-5a90b9ac6f2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:13.269482 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5d9dff04-cc7f-464b-bfb2-5a90b9ac6f2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:13.509583 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-86de84c4-762e-4b3f-8762-f3113fe98583 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:13.510376 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-86de84c4-762e-4b3f-8762-f3113fe98583 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:13.516569 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-86de84c4-762e-4b3f-8762-f3113fe98583 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:13.517634 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-86de84c4-762e-4b3f-8762-f3113fe98583 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:13.518417 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-86de84c4-762e-4b3f-8762-f3113fe98583 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:13.518843 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-86de84c4-762e-4b3f-8762-f3113fe98583 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:13.681620 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5d9dff04-cc7f-464b-bfb2-5a90b9ac6f2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:13.690021 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5d9dff04-cc7f-464b-bfb2-5a90b9ac6f2e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.432923 Feb 21 04:17:13.690799 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 214/412] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:13 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:13.772270 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-86de84c4-762e-4b3f-8762-f3113fe98583 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:13.781192 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-86de84c4-762e-4b3f-8762-f3113fe98583 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.275259 Feb 21 04:17:13.782304 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 199/413] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:13 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:14.706936 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a35a77f7-dbd7-4aa3-9bcf-e86343fe95d7 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:14.707581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a35a77f7-dbd7-4aa3-9bcf-e86343fe95d7 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:14.713671 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a35a77f7-dbd7-4aa3-9bcf-e86343fe95d7 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:14.714121 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a35a77f7-dbd7-4aa3-9bcf-e86343fe95d7 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:14.714896 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a35a77f7-dbd7-4aa3-9bcf-e86343fe95d7 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:14.715331 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a35a77f7-dbd7-4aa3-9bcf-e86343fe95d7 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:14.802390 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f3c4b78d-42aa-4ea8-986b-f1dac26c4c18 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:14.802984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f3c4b78d-42aa-4ea8-986b-f1dac26c4c18 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:14.809369 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f3c4b78d-42aa-4ea8-986b-f1dac26c4c18 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:14.809815 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f3c4b78d-42aa-4ea8-986b-f1dac26c4c18 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:14.810577 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f3c4b78d-42aa-4ea8-986b-f1dac26c4c18 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:14.811004 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f3c4b78d-42aa-4ea8-986b-f1dac26c4c18 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:15.027865 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a35a77f7-dbd7-4aa3-9bcf-e86343fe95d7 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:15.035769 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a35a77f7-dbd7-4aa3-9bcf-e86343fe95d7 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.332519 Feb 21 04:17:15.036344 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 215/414] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:14 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:15.097365 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f3c4b78d-42aa-4ea8-986b-f1dac26c4c18 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:15.105476 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f3c4b78d-42aa-4ea8-986b-f1dac26c4c18 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1318 microversion: 2.1 time: 0.307037 Feb 21 04:17:15.106367 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 200/415] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:14 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:15.198051 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-9f0f882e-4d0b-4958-a2dd-337bd308938a req-f2370515-2b57-4641-905c-2ba9e4aee220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59362492-1a50-4bb3-a8a7-b29eb51489e4", "tag": "2f0ab78e-d156-44f8-a2e4-b409bf502408"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:15.202338 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:17:15.202338 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:17:15.225340 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-9f0f882e-4d0b-4958-a2dd-337bd308938a req-f2370515-2b57-4641-905c-2ba9e4aee220 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:15.225788 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-9f0f882e-4d0b-4958-a2dd-337bd308938a req-f2370515-2b57-4641-905c-2ba9e4aee220 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:15.236812 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-9f0f882e-4d0b-4958-a2dd-337bd308938a req-f2370515-2b57-4641-905c-2ba9e4aee220 service nova] Creating event network-changed:2f0ab78e-d156-44f8-a2e4-b409bf502408 for instance 59362492-1a50-4bb3-a8a7-b29eb51489e4 on hv-cinder-77398 Feb 21 04:17:15.241792 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-9f0f882e-4d0b-4958-a2dd-337bd308938a req-f2370515-2b57-4641-905c-2ba9e4aee220 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053218 Feb 21 04:17:15.242626 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 216/416] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:16.060478 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-66db38c2-d97e-414b-884e-76fbc0ec7e74 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:16.066238 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-66db38c2-d97e-414b-884e-76fbc0ec7e74 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:16.082191 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-66db38c2-d97e-414b-884e-76fbc0ec7e74 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:16.082982 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-66db38c2-d97e-414b-884e-76fbc0ec7e74 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:16.086949 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-66db38c2-d97e-414b-884e-76fbc0ec7e74 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:16.087651 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-66db38c2-d97e-414b-884e-76fbc0ec7e74 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:16.123248 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6545fd77-e986-4cef-b685-a35cc6cbd3c7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:16.124178 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6545fd77-e986-4cef-b685-a35cc6cbd3c7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:16.133127 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6545fd77-e986-4cef-b685-a35cc6cbd3c7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:16.133959 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6545fd77-e986-4cef-b685-a35cc6cbd3c7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:16.134767 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6545fd77-e986-4cef-b685-a35cc6cbd3c7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:16.135193 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6545fd77-e986-4cef-b685-a35cc6cbd3c7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:16.342827 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-66db38c2-d97e-414b-884e-76fbc0ec7e74 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:16.362066 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-66db38c2-d97e-414b-884e-76fbc0ec7e74 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.312282 Feb 21 04:17:16.362673 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 201/417] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:16 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:16.366196 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6545fd77-e986-4cef-b685-a35cc6cbd3c7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:16.374592 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6545fd77-e986-4cef-b685-a35cc6cbd3c7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1509 microversion: 2.1 time: 0.255789 Feb 21 04:17:16.376705 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 217/418] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:16 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:16.400474 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2559dd17-99e7-4b20-a670-2aa4b1dc4d41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1555835675"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:16.401047 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2559dd17-99e7-4b20-a670-2aa4b1dc4d41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:16.407382 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2559dd17-99e7-4b20-a670-2aa4b1dc4d41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:16.408462 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2559dd17-99e7-4b20-a670-2aa4b1dc4d41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:16.409328 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2559dd17-99e7-4b20-a670-2aa4b1dc4d41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:16.409756 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2559dd17-99e7-4b20-a670-2aa4b1dc4d41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:16.564311 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.network.security_group_api [None req-2559dd17-99e7-4b20-a670-2aa4b1dc4d41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Adding security group ed61422c-2596-47a4-a867-ceb2b47dee59 to port 2f0ab78e-d156-44f8-a2e4-b409bf502408 Feb 21 04:17:17.121152 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2559dd17-99e7-4b20-a670-2aa4b1dc4d41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "POST /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/action" status: 202 len: 0 microversion: 2.1 time: 0.723870 Feb 21 04:17:17.122924 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 202/419] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:17:16 2022] POST /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/action => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:17:17.134563 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3d94e520-2b84-4fb2-be9e-6967c22456c1 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:17.135662 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3d94e520-2b84-4fb2-be9e-6967c22456c1 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:17.148806 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3d94e520-2b84-4fb2-be9e-6967c22456c1 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:17.149261 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3d94e520-2b84-4fb2-be9e-6967c22456c1 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:17.150064 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3d94e520-2b84-4fb2-be9e-6967c22456c1 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:17.150501 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3d94e520-2b84-4fb2-be9e-6967c22456c1 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:17.256514 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-62a977d6-f041-4bdd-bb8b-a8a7cd28330d req-c18610ab-413a-47ee-bc78-22f6e526c3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59362492-1a50-4bb3-a8a7-b29eb51489e4", "tag": "2f0ab78e-d156-44f8-a2e4-b409bf502408"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:17.258089 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:17:17.258089 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:17:17.276226 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-62a977d6-f041-4bdd-bb8b-a8a7cd28330d req-c18610ab-413a-47ee-bc78-22f6e526c3b2 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:17.276226 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-62a977d6-f041-4bdd-bb8b-a8a7cd28330d req-c18610ab-413a-47ee-bc78-22f6e526c3b2 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:17.289350 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-62a977d6-f041-4bdd-bb8b-a8a7cd28330d req-c18610ab-413a-47ee-bc78-22f6e526c3b2 service nova] Creating event network-changed:2f0ab78e-d156-44f8-a2e4-b409bf502408 for instance 59362492-1a50-4bb3-a8a7-b29eb51489e4 on hv-cinder-77398 Feb 21 04:17:17.295614 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-62a977d6-f041-4bdd-bb8b-a8a7cd28330d req-c18610ab-413a-47ee-bc78-22f6e526c3b2 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042490 Feb 21 04:17:17.296795 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 203/420] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:17.368618 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-3d94e520-2b84-4fb2-be9e-6967c22456c1 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:17.378990 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3d94e520-2b84-4fb2-be9e-6967c22456c1 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1760 microversion: 2.1 time: 0.251282 Feb 21 04:17:17.380207 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 218/421] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:17 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1760 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:17.380386 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d1b706d1-929b-456e-9614-f895b146ee1c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:17.381106 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d1b706d1-929b-456e-9614-f895b146ee1c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:17.388929 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d1b706d1-929b-456e-9614-f895b146ee1c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:17.389829 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d1b706d1-929b-456e-9614-f895b146ee1c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:17.390760 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d1b706d1-929b-456e-9614-f895b146ee1c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:17.391340 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d1b706d1-929b-456e-9614-f895b146ee1c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:17.648809 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d1b706d1-929b-456e-9614-f895b146ee1c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:17.657000 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d1b706d1-929b-456e-9614-f895b146ee1c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.281716 Feb 21 04:17:17.663138 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 204/422] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:17 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:18.674574 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3792a2cd-5092-48d0-b671-06010d2ad678 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:18.675124 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3792a2cd-5092-48d0-b671-06010d2ad678 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:18.681474 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3792a2cd-5092-48d0-b671-06010d2ad678 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:18.681922 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3792a2cd-5092-48d0-b671-06010d2ad678 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:18.682687 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3792a2cd-5092-48d0-b671-06010d2ad678 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:18.683118 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3792a2cd-5092-48d0-b671-06010d2ad678 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:18.822621 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-3792a2cd-5092-48d0-b671-06010d2ad678 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:18.830893 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3792a2cd-5092-48d0-b671-06010d2ad678 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.160111 Feb 21 04:17:18.831456 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 219/423] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:18 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:19.817115 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5f72bf7b-fac4-4dcb-b74c-f88c35518278 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "393443ed-13a6-4bf1-906b-5172cc5ca89d"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:19.818187 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5f72bf7b-fac4-4dcb-b74c-f88c35518278 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:19.824513 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5f72bf7b-fac4-4dcb-b74c-f88c35518278 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:19.824991 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5f72bf7b-fac4-4dcb-b74c-f88c35518278 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:19.825768 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5f72bf7b-fac4-4dcb-b74c-f88c35518278 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:19.826282 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5f72bf7b-fac4-4dcb-b74c-f88c35518278 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:19.848611 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-47c2f419-23da-44ce-b4d7-5d8fdc18661e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:19.849359 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-47c2f419-23da-44ce-b4d7-5d8fdc18661e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:19.855555 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-47c2f419-23da-44ce-b4d7-5d8fdc18661e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:19.856096 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-47c2f419-23da-44ce-b4d7-5d8fdc18661e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:19.856968 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-47c2f419-23da-44ce-b4d7-5d8fdc18661e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:19.857465 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-47c2f419-23da-44ce-b4d7-5d8fdc18661e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:19.998746 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-47c2f419-23da-44ce-b4d7-5d8fdc18661e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:20.006583 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-47c2f419-23da-44ce-b4d7-5d8fdc18661e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.162169 Feb 21 04:17:20.007150 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 220/424] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:19 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:20.075043 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5f72bf7b-fac4-4dcb-b74c-f88c35518278 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "POST /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262620 Feb 21 04:17:20.075645 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 205/425] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:17:19 2022] POST /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:21.024247 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7851e52c-12ad-49f4-9112-2a6ca52055f3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:21.024910 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7851e52c-12ad-49f4-9112-2a6ca52055f3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:21.031668 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7851e52c-12ad-49f4-9112-2a6ca52055f3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:21.032131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7851e52c-12ad-49f4-9112-2a6ca52055f3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:21.032970 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7851e52c-12ad-49f4-9112-2a6ca52055f3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:21.033408 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7851e52c-12ad-49f4-9112-2a6ca52055f3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:21.170115 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7851e52c-12ad-49f4-9112-2a6ca52055f3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:21.179060 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7851e52c-12ad-49f4-9112-2a6ca52055f3 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.158470 Feb 21 04:17:21.179703 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 221/426] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:21 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:22.195979 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f3a53c3e-664e-44d8-8f22-d54538b27273 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:22.196695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f3a53c3e-664e-44d8-8f22-d54538b27273 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:22.202747 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f3a53c3e-664e-44d8-8f22-d54538b27273 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:22.203134 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f3a53c3e-664e-44d8-8f22-d54538b27273 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:22.203905 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f3a53c3e-664e-44d8-8f22-d54538b27273 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:22.204329 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f3a53c3e-664e-44d8-8f22-d54538b27273 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:22.341035 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f3a53c3e-664e-44d8-8f22-d54538b27273 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:22.349643 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f3a53c3e-664e-44d8-8f22-d54538b27273 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.158167 Feb 21 04:17:22.350281 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 206/427] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:22 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:23.366950 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-990622eb-8781-4040-939f-c5fa67cbc97e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:23.368276 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-990622eb-8781-4040-939f-c5fa67cbc97e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:23.375760 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-990622eb-8781-4040-939f-c5fa67cbc97e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:23.376249 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-990622eb-8781-4040-939f-c5fa67cbc97e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:23.377179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-990622eb-8781-4040-939f-c5fa67cbc97e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:23.377605 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-990622eb-8781-4040-939f-c5fa67cbc97e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:23.586175 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-990622eb-8781-4040-939f-c5fa67cbc97e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:23.593989 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-990622eb-8781-4040-939f-c5fa67cbc97e tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.230611 Feb 21 04:17:23.594622 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 222/428] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:23 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:24.613372 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f892a713-53bb-46cd-b5b6-5cbce7b63b9f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:24.613973 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f892a713-53bb-46cd-b5b6-5cbce7b63b9f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:24.620106 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f892a713-53bb-46cd-b5b6-5cbce7b63b9f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:24.620547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f892a713-53bb-46cd-b5b6-5cbce7b63b9f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:24.621346 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f892a713-53bb-46cd-b5b6-5cbce7b63b9f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:24.621774 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f892a713-53bb-46cd-b5b6-5cbce7b63b9f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:24.758226 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f892a713-53bb-46cd-b5b6-5cbce7b63b9f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:24.765979 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f892a713-53bb-46cd-b5b6-5cbce7b63b9f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.156638 Feb 21 04:17:24.766550 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 207/429] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:24 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:25.782773 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4a63df9a-7133-4cb6-8708-cd2b68f0137d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:25.784382 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4a63df9a-7133-4cb6-8708-cd2b68f0137d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:25.791806 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4a63df9a-7133-4cb6-8708-cd2b68f0137d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:25.792257 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4a63df9a-7133-4cb6-8708-cd2b68f0137d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:25.793074 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4a63df9a-7133-4cb6-8708-cd2b68f0137d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:25.793509 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4a63df9a-7133-4cb6-8708-cd2b68f0137d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:25.934265 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4a63df9a-7133-4cb6-8708-cd2b68f0137d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:25.942691 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4a63df9a-7133-4cb6-8708-cd2b68f0137d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1567 microversion: 2.1 time: 0.163427 Feb 21 04:17:25.943235 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 223/430] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:25 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:26.959962 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ea6aef04-6773-4017-a29b-51b46bafd90a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:26.960490 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ea6aef04-6773-4017-a29b-51b46bafd90a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:26.966678 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ea6aef04-6773-4017-a29b-51b46bafd90a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:26.967117 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ea6aef04-6773-4017-a29b-51b46bafd90a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:26.967877 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ea6aef04-6773-4017-a29b-51b46bafd90a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:26.968337 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ea6aef04-6773-4017-a29b-51b46bafd90a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:27.099177 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ea6aef04-6773-4017-a29b-51b46bafd90a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:27.106803 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ea6aef04-6773-4017-a29b-51b46bafd90a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1547 microversion: 2.1 time: 0.151085 Feb 21 04:17:27.107365 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 208/431] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:26 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:27.123396 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8957f617-f1c7-4382-be90-780196c80141 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:27.123934 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-8957f617-f1c7-4382-be90-780196c80141 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:27.130610 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8957f617-f1c7-4382-be90-780196c80141 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:27.131056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8957f617-f1c7-4382-be90-780196c80141 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:27.131821 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8957f617-f1c7-4382-be90-780196c80141 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:27.132250 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8957f617-f1c7-4382-be90-780196c80141 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:27.251979 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-8957f617-f1c7-4382-be90-780196c80141 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] HTTP exception thrown: Cannot 'detach_volume' instance 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d while it is in vm_state rescued Feb 21 04:17:27.253114 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8957f617-f1c7-4382-be90-780196c80141 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Returning 409 to user: Cannot 'detach_volume' instance 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d while it is in vm_state rescued {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:17:27.253934 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-8957f617-f1c7-4382-be90-780196c80141 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "DELETE /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments/1278f265-415b-430a-878f-6fc33137ec08" status: 409 len: 152 microversion: 2.1 time: 0.134789 Feb 21 04:17:27.254471 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 224/432] 10.222.0.10 () {58 vars in 1415 bytes} [Mon Feb 21 04:17:27 2022] DELETE /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments/1278f265-415b-430a-878f-6fc33137ec08 => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 21 04:17:27.262654 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2199f175-c7e1-4b10-a4aa-c8e1f42d782f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:27.263184 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2199f175-c7e1-4b10-a4aa-c8e1f42d782f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:27.269519 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2199f175-c7e1-4b10-a4aa-c8e1f42d782f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:27.269964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2199f175-c7e1-4b10-a4aa-c8e1f42d782f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:27.270766 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2199f175-c7e1-4b10-a4aa-c8e1f42d782f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:27.271269 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2199f175-c7e1-4b10-a4aa-c8e1f42d782f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:27.336363 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2199f175-c7e1-4b10-a4aa-c8e1f42d782f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "POST /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/action" status: 202 len: 0 microversion: 2.1 time: 0.077219 Feb 21 04:17:27.340024 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 209/433] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:17:27 2022] POST /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:17:27.345068 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-28cf81f2-375f-4e91-87da-84f058f02926 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:27.345772 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-28cf81f2-375f-4e91-87da-84f058f02926 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:27.352066 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-28cf81f2-375f-4e91-87da-84f058f02926 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:27.352517 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-28cf81f2-375f-4e91-87da-84f058f02926 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:27.353363 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-28cf81f2-375f-4e91-87da-84f058f02926 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:27.354019 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-28cf81f2-375f-4e91-87da-84f058f02926 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:27.574632 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-28cf81f2-375f-4e91-87da-84f058f02926 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:27.582179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-28cf81f2-375f-4e91-87da-84f058f02926 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1555 microversion: 2.1 time: 0.240859 Feb 21 04:17:27.582998 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 225/434] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:27 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:28.600435 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6de5c33d-aaec-487c-9570-dbcd3ba39f06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:28.601215 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6de5c33d-aaec-487c-9570-dbcd3ba39f06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:28.607627 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6de5c33d-aaec-487c-9570-dbcd3ba39f06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:28.608071 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6de5c33d-aaec-487c-9570-dbcd3ba39f06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:28.608892 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6de5c33d-aaec-487c-9570-dbcd3ba39f06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:28.609321 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6de5c33d-aaec-487c-9570-dbcd3ba39f06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:28.753969 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6de5c33d-aaec-487c-9570-dbcd3ba39f06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:28.761682 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6de5c33d-aaec-487c-9570-dbcd3ba39f06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1555 microversion: 2.1 time: 0.165916 Feb 21 04:17:28.762284 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 210/435] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:28 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:29.778878 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a5da9fc4-267f-4f69-a2d9-8c99b8a0868c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:29.779484 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a5da9fc4-267f-4f69-a2d9-8c99b8a0868c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:29.786525 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a5da9fc4-267f-4f69-a2d9-8c99b8a0868c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:29.786969 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a5da9fc4-267f-4f69-a2d9-8c99b8a0868c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:29.787770 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a5da9fc4-267f-4f69-a2d9-8c99b8a0868c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:29.788191 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a5da9fc4-267f-4f69-a2d9-8c99b8a0868c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:29.923815 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a5da9fc4-267f-4f69-a2d9-8c99b8a0868c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:29.931691 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a5da9fc4-267f-4f69-a2d9-8c99b8a0868c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1555 microversion: 2.1 time: 0.156602 Feb 21 04:17:29.932040 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 226/436] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:29 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:30.953286 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1821d497-43f0-4d71-a35e-1553bac175ac tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:30.953901 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1821d497-43f0-4d71-a35e-1553bac175ac tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:30.960825 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1821d497-43f0-4d71-a35e-1553bac175ac tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:30.961286 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1821d497-43f0-4d71-a35e-1553bac175ac tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:30.962104 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1821d497-43f0-4d71-a35e-1553bac175ac tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:30.962710 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1821d497-43f0-4d71-a35e-1553bac175ac tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:31.093806 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1821d497-43f0-4d71-a35e-1553bac175ac tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:31.102058 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1821d497-43f0-4d71-a35e-1553bac175ac tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1555 microversion: 2.1 time: 0.152334 Feb 21 04:17:31.102624 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 211/437] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:30 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:32.118679 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-65cd5c9f-586b-45bb-bea8-78a94f938d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:32.119290 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-65cd5c9f-586b-45bb-bea8-78a94f938d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:32.125502 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-65cd5c9f-586b-45bb-bea8-78a94f938d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:32.125953 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-65cd5c9f-586b-45bb-bea8-78a94f938d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:32.126728 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-65cd5c9f-586b-45bb-bea8-78a94f938d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:32.127747 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-65cd5c9f-586b-45bb-bea8-78a94f938d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:32.265337 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-65cd5c9f-586b-45bb-bea8-78a94f938d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:32.272982 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-65cd5c9f-586b-45bb-bea8-78a94f938d5f tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1561 microversion: 2.1 time: 0.157856 Feb 21 04:17:32.273555 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 227/438] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:32 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:32.336864 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f5502a93-4ac3-4a96-beae-8adf76e801aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:32.337378 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f5502a93-4ac3-4a96-beae-8adf76e801aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:32.343455 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f5502a93-4ac3-4a96-beae-8adf76e801aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:32.343901 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f5502a93-4ac3-4a96-beae-8adf76e801aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:32.344691 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f5502a93-4ac3-4a96-beae-8adf76e801aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:32.345132 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f5502a93-4ac3-4a96-beae-8adf76e801aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:32.418804 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-f5502a93-4ac3-4a96-beae-8adf76e801aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lazy-loading 'services' on Instance uuid 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:17:32.484209 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f5502a93-4ac3-4a96-beae-8adf76e801aa tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "DELETE /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments/1278f265-415b-430a-878f-6fc33137ec08" status: 202 len: 0 microversion: 2.1 time: 0.150951 Feb 21 04:17:32.485054 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 212/439] 10.222.0.10 () {58 vars in 1415 bytes} [Mon Feb 21 04:17:32 2022] DELETE /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments/1278f265-415b-430a-878f-6fc33137ec08 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:17:32.494230 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7f3ac435-809c-417e-9223-2dee8aad3198 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:32.496188 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7f3ac435-809c-417e-9223-2dee8aad3198 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:32.502114 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7f3ac435-809c-417e-9223-2dee8aad3198 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:32.502565 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7f3ac435-809c-417e-9223-2dee8aad3198 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:32.503353 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7f3ac435-809c-417e-9223-2dee8aad3198 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:32.503792 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7f3ac435-809c-417e-9223-2dee8aad3198 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:32.533190 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7f3ac435-809c-417e-9223-2dee8aad3198 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042587 Feb 21 04:17:32.534339 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 228/440] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:32 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:17:33.546268 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3efdd63f-0a04-4431-bda1-cd1460dd02d9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:33.547300 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3efdd63f-0a04-4431-bda1-cd1460dd02d9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:33.553316 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3efdd63f-0a04-4431-bda1-cd1460dd02d9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:33.553755 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3efdd63f-0a04-4431-bda1-cd1460dd02d9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:33.554514 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3efdd63f-0a04-4431-bda1-cd1460dd02d9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:33.554938 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3efdd63f-0a04-4431-bda1-cd1460dd02d9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:33.582689 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3efdd63f-0a04-4431-bda1-cd1460dd02d9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040959 Feb 21 04:17:33.583217 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 213/441] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:33 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:17:34.594348 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ac4413c7-bf39-466e-ade3-12b0a47c46e9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:34.595253 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ac4413c7-bf39-466e-ade3-12b0a47c46e9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:34.601968 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ac4413c7-bf39-466e-ade3-12b0a47c46e9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:34.602414 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ac4413c7-bf39-466e-ade3-12b0a47c46e9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:34.603187 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ac4413c7-bf39-466e-ade3-12b0a47c46e9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:34.603616 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ac4413c7-bf39-466e-ade3-12b0a47c46e9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:34.631922 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ac4413c7-bf39-466e-ade3-12b0a47c46e9 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041317 Feb 21 04:17:34.632494 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 229/442] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:34 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:35.643154 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2b9f5a37-452e-4ed2-873b-d727004b5c87 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:35.644057 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2b9f5a37-452e-4ed2-873b-d727004b5c87 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:35.650286 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2b9f5a37-452e-4ed2-873b-d727004b5c87 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:35.650734 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2b9f5a37-452e-4ed2-873b-d727004b5c87 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:35.651506 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2b9f5a37-452e-4ed2-873b-d727004b5c87 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:35.651965 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2b9f5a37-452e-4ed2-873b-d727004b5c87 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:35.680243 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2b9f5a37-452e-4ed2-873b-d727004b5c87 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040898 Feb 21 04:17:35.680808 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 214/443] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:35 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:36.691972 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e2d97fc8-415d-4aad-9766-271843730bad tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:36.692963 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e2d97fc8-415d-4aad-9766-271843730bad tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:36.699217 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e2d97fc8-415d-4aad-9766-271843730bad tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:36.699666 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e2d97fc8-415d-4aad-9766-271843730bad tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:36.700437 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e2d97fc8-415d-4aad-9766-271843730bad tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:36.700899 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e2d97fc8-415d-4aad-9766-271843730bad tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:36.731111 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e2d97fc8-415d-4aad-9766-271843730bad tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043396 Feb 21 04:17:36.731649 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 230/444] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:36 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:37.742894 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-df7fcdfc-8cb9-4895-bce4-3c0359d80c13 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:37.743885 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-df7fcdfc-8cb9-4895-bce4-3c0359d80c13 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:37.750140 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-df7fcdfc-8cb9-4895-bce4-3c0359d80c13 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:37.750583 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-df7fcdfc-8cb9-4895-bce4-3c0359d80c13 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:37.751347 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-df7fcdfc-8cb9-4895-bce4-3c0359d80c13 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:37.751771 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-df7fcdfc-8cb9-4895-bce4-3c0359d80c13 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:37.782051 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-df7fcdfc-8cb9-4895-bce4-3c0359d80c13 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042918 Feb 21 04:17:37.782609 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 215/445] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:37 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:38.793907 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d56c7421-7f6d-4d2f-a119-5a2efa7d1e2d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:38.794811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d56c7421-7f6d-4d2f-a119-5a2efa7d1e2d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:38.801542 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d56c7421-7f6d-4d2f-a119-5a2efa7d1e2d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:38.801989 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d56c7421-7f6d-4d2f-a119-5a2efa7d1e2d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:38.802753 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d56c7421-7f6d-4d2f-a119-5a2efa7d1e2d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:38.803187 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d56c7421-7f6d-4d2f-a119-5a2efa7d1e2d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:38.831580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d56c7421-7f6d-4d2f-a119-5a2efa7d1e2d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041373 Feb 21 04:17:38.832119 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 231/446] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:38 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:39.842917 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-453558c2-4397-48da-8126-1202aaf50305 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:39.843811 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-453558c2-4397-48da-8126-1202aaf50305 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:39.849952 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-453558c2-4397-48da-8126-1202aaf50305 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:39.850395 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-453558c2-4397-48da-8126-1202aaf50305 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:39.851168 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-453558c2-4397-48da-8126-1202aaf50305 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:39.851602 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-453558c2-4397-48da-8126-1202aaf50305 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:39.880382 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-453558c2-4397-48da-8126-1202aaf50305 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041152 Feb 21 04:17:39.881028 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 216/447] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:39 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:40.891712 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-52943349-da07-4232-b5db-1dd6f606d685 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:40.892670 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-52943349-da07-4232-b5db-1dd6f606d685 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:40.898825 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-52943349-da07-4232-b5db-1dd6f606d685 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:40.899269 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-52943349-da07-4232-b5db-1dd6f606d685 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:40.900033 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-52943349-da07-4232-b5db-1dd6f606d685 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:40.900461 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-52943349-da07-4232-b5db-1dd6f606d685 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:40.931916 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-52943349-da07-4232-b5db-1dd6f606d685 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 Feb 21 04:17:40.932467 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 232/448] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:40 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:41.943887 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8ec547d4-2a8c-403f-b4b8-66163a29d278 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:41.944740 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8ec547d4-2a8c-403f-b4b8-66163a29d278 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:41.950918 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8ec547d4-2a8c-403f-b4b8-66163a29d278 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:41.951363 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8ec547d4-2a8c-403f-b4b8-66163a29d278 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:41.952132 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8ec547d4-2a8c-403f-b4b8-66163a29d278 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:41.952564 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8ec547d4-2a8c-403f-b4b8-66163a29d278 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:41.980613 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8ec547d4-2a8c-403f-b4b8-66163a29d278 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041039 Feb 21 04:17:41.981185 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 217/449] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:41 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:42.404650 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-163d66c6-856d-42db-a9ae-b00e21e08598 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "393443ed-13a6-4bf1-906b-5172cc5ca89d"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:42.405811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-163d66c6-856d-42db-a9ae-b00e21e08598 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:42.411804 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-163d66c6-856d-42db-a9ae-b00e21e08598 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:42.412265 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-163d66c6-856d-42db-a9ae-b00e21e08598 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:42.413060 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-163d66c6-856d-42db-a9ae-b00e21e08598 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:42.413489 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-163d66c6-856d-42db-a9ae-b00e21e08598 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:42.488098 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-163d66c6-856d-42db-a9ae-b00e21e08598 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] HTTP exception thrown: Invalid volume: volume 393443ed-13a6-4bf1-906b-5172cc5ca89d is already attached to instances: 38295c86-79cf-4f53-828c-2f9e5350d0c8 Feb 21 04:17:42.488720 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-163d66c6-856d-42db-a9ae-b00e21e08598 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Returning 400 to user: Invalid volume: volume 393443ed-13a6-4bf1-906b-5172cc5ca89d is already attached to instances: 38295c86-79cf-4f53-828c-2f9e5350d0c8 {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:17:42.489578 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-163d66c6-856d-42db-a9ae-b00e21e08598 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "POST /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089166 Feb 21 04:17:42.490116 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 233/450] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:17:42 2022] POST /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments => generated 174 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 21 04:17:42.544427 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b667b725-8cd6-42ce-b4c2-098d54f6be3c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:42.544936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b667b725-8cd6-42ce-b4c2-098d54f6be3c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:42.551087 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b667b725-8cd6-42ce-b4c2-098d54f6be3c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:42.551526 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b667b725-8cd6-42ce-b4c2-098d54f6be3c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:42.552284 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b667b725-8cd6-42ce-b4c2-098d54f6be3c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:42.552745 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b667b725-8cd6-42ce-b4c2-098d54f6be3c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:42.625798 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-b667b725-8cd6-42ce-b4c2-098d54f6be3c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lazy-loading 'services' on Instance uuid 38295c86-79cf-4f53-828c-2f9e5350d0c8 {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:17:42.692280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b667b725-8cd6-42ce-b4c2-098d54f6be3c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "DELETE /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments/393443ed-13a6-4bf1-906b-5172cc5ca89d" status: 202 len: 0 microversion: 2.1 time: 0.151280 Feb 21 04:17:42.692904 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 218/451] 10.222.0.10 () {58 vars in 1415 bytes} [Mon Feb 21 04:17:42 2022] DELETE /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments/393443ed-13a6-4bf1-906b-5172cc5ca89d => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:17:42.701136 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c8c43423-fdd3-4254-9174-1044be20e7ce tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:42.702104 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c8c43423-fdd3-4254-9174-1044be20e7ce tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:42.707881 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c8c43423-fdd3-4254-9174-1044be20e7ce tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:42.708293 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c8c43423-fdd3-4254-9174-1044be20e7ce tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:42.709177 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c8c43423-fdd3-4254-9174-1044be20e7ce tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:42.709515 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c8c43423-fdd3-4254-9174-1044be20e7ce tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:42.740134 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c8c43423-fdd3-4254-9174-1044be20e7ce tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042560 Feb 21 04:17:42.740984 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 234/452] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:42 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:42.993624 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b01005df-83e2-46f7-a044-bf601235b350 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:42.994634 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b01005df-83e2-46f7-a044-bf601235b350 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:43.001246 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b01005df-83e2-46f7-a044-bf601235b350 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:43.001690 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b01005df-83e2-46f7-a044-bf601235b350 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:43.002460 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b01005df-83e2-46f7-a044-bf601235b350 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:43.002894 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b01005df-83e2-46f7-a044-bf601235b350 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:43.032306 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b01005df-83e2-46f7-a044-bf601235b350 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043186 Feb 21 04:17:43.032882 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 219/453] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:42 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:43.751224 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fb6f1b05-c89e-4daf-81fd-7ff3477152c6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:43.752157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fb6f1b05-c89e-4daf-81fd-7ff3477152c6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:43.759417 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fb6f1b05-c89e-4daf-81fd-7ff3477152c6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:43.759869 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fb6f1b05-c89e-4daf-81fd-7ff3477152c6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:43.760707 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fb6f1b05-c89e-4daf-81fd-7ff3477152c6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:43.761179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fb6f1b05-c89e-4daf-81fd-7ff3477152c6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:43.789351 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fb6f1b05-c89e-4daf-81fd-7ff3477152c6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041825 Feb 21 04:17:43.789842 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 235/454] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:43 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:44.044482 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ba60c76a-4508-4129-8cd7-ff6fca6e887a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:44.045337 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ba60c76a-4508-4129-8cd7-ff6fca6e887a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:44.052174 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ba60c76a-4508-4129-8cd7-ff6fca6e887a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:44.052620 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ba60c76a-4508-4129-8cd7-ff6fca6e887a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:44.053411 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ba60c76a-4508-4129-8cd7-ff6fca6e887a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:44.053870 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ba60c76a-4508-4129-8cd7-ff6fca6e887a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:44.082423 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ba60c76a-4508-4129-8cd7-ff6fca6e887a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041670 Feb 21 04:17:44.082970 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 220/455] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:44 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 04:17:44.801006 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-473e9356-5783-4f63-addc-d2b3fb0b9413 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:44.803311 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-473e9356-5783-4f63-addc-d2b3fb0b9413 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:44.812396 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-473e9356-5783-4f63-addc-d2b3fb0b9413 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:44.813135 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-473e9356-5783-4f63-addc-d2b3fb0b9413 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:44.813978 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-473e9356-5783-4f63-addc-d2b3fb0b9413 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:44.814450 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-473e9356-5783-4f63-addc-d2b3fb0b9413 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:44.845657 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-473e9356-5783-4f63-addc-d2b3fb0b9413 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048313 Feb 21 04:17:44.846217 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 236/456] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:44 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:45.858115 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-bbca29f3-abda-43e6-a7c6-7c324c40a5cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:45.859130 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-bbca29f3-abda-43e6-a7c6-7c324c40a5cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:45.866410 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bbca29f3-abda-43e6-a7c6-7c324c40a5cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:45.866789 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bbca29f3-abda-43e6-a7c6-7c324c40a5cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:45.867602 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bbca29f3-abda-43e6-a7c6-7c324c40a5cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:45.868036 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bbca29f3-abda-43e6-a7c6-7c324c40a5cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:45.898154 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-bbca29f3-abda-43e6-a7c6-7c324c40a5cd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043943 Feb 21 04:17:45.901937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 221/457] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:45 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:46.398836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e44ad5ff-5af5-4382-a509-e55c42c9cf83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:46.399349 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e44ad5ff-5af5-4382-a509-e55c42c9cf83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:46.405607 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e44ad5ff-5af5-4382-a509-e55c42c9cf83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:46.406106 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e44ad5ff-5af5-4382-a509-e55c42c9cf83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:46.406899 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e44ad5ff-5af5-4382-a509-e55c42c9cf83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:46.407326 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e44ad5ff-5af5-4382-a509-e55c42c9cf83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:46.430664 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e44ad5ff-5af5-4382-a509-e55c42c9cf83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Going to try to terminate instance {{(pid=116571) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:17:46.502135 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e44ad5ff-5af5-4382-a509-e55c42c9cf83 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "DELETE /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 204 len: 0 microversion: 2.1 time: 0.107715 Feb 21 04:17:46.502890 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 237/458] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:17:46 2022] DELETE /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:17:46.511522 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-dad7feec-07b7-43ac-86ac-cfa5f5b5124c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:46.512154 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-dad7feec-07b7-43ac-86ac-cfa5f5b5124c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:46.518632 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dad7feec-07b7-43ac-86ac-cfa5f5b5124c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:46.519889 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dad7feec-07b7-43ac-86ac-cfa5f5b5124c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:46.520698 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dad7feec-07b7-43ac-86ac-cfa5f5b5124c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:46.521129 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dad7feec-07b7-43ac-86ac-cfa5f5b5124c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:46.650755 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-dad7feec-07b7-43ac-86ac-cfa5f5b5124c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:46.658207 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-dad7feec-07b7-43ac-86ac-cfa5f5b5124c tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1508 microversion: 2.1 time: 0.150638 Feb 21 04:17:46.658763 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 222/459] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:46 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:46.910395 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-40a9088c-64ce-4f3c-aed3-b828e1d1054c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:46.911391 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-40a9088c-64ce-4f3c-aed3-b828e1d1054c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:46.917089 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-40a9088c-64ce-4f3c-aed3-b828e1d1054c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:46.917541 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-40a9088c-64ce-4f3c-aed3-b828e1d1054c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:46.918348 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-40a9088c-64ce-4f3c-aed3-b828e1d1054c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:46.918785 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-40a9088c-64ce-4f3c-aed3-b828e1d1054c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:46.948519 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-40a9088c-64ce-4f3c-aed3-b828e1d1054c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Feb 21 04:17:46.949101 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 238/460] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:46 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:47.674531 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-badd63f5-d8a8-46f9-9817-0f3698e5d34a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:47.675212 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-badd63f5-d8a8-46f9-9817-0f3698e5d34a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:47.681557 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-badd63f5-d8a8-46f9-9817-0f3698e5d34a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:47.681937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-badd63f5-d8a8-46f9-9817-0f3698e5d34a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:47.682714 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-badd63f5-d8a8-46f9-9817-0f3698e5d34a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:47.683151 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-badd63f5-d8a8-46f9-9817-0f3698e5d34a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:47.814297 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-badd63f5-d8a8-46f9-9817-0f3698e5d34a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:47.821466 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-badd63f5-d8a8-46f9-9817-0f3698e5d34a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1508 microversion: 2.1 time: 0.150552 Feb 21 04:17:47.822034 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 223/461] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:47 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:47.959705 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e14b9733-8b8d-4187-8568-b73ee5bba587 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:47.960545 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e14b9733-8b8d-4187-8568-b73ee5bba587 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:47.966830 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e14b9733-8b8d-4187-8568-b73ee5bba587 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:47.967273 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e14b9733-8b8d-4187-8568-b73ee5bba587 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:47.968033 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e14b9733-8b8d-4187-8568-b73ee5bba587 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:47.968458 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e14b9733-8b8d-4187-8568-b73ee5bba587 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:47.996979 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e14b9733-8b8d-4187-8568-b73ee5bba587 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041536 Feb 21 04:17:47.997527 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 239/462] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:47 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:48.505871 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1755999971", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "networks": [{"uuid": "1696394a-e11c-40a2-ae99-8cf4069591fe"}]}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:48.557760 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.network.neutron [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] validate_networks() for [('1696394a-e11c-40a2-ae99-8cf4069591fe', None, None, None, None, None)] {{(pid=116570) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:17:48.838085 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-02dd4204-8a15-4520-a7fa-69a087b2edb5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:48.838705 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-02dd4204-8a15-4520-a7fa-69a087b2edb5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:48.844835 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-02dd4204-8a15-4520-a7fa-69a087b2edb5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:48.845288 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-02dd4204-8a15-4520-a7fa-69a087b2edb5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:48.846067 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-02dd4204-8a15-4520-a7fa-69a087b2edb5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:48.846502 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-02dd4204-8a15-4520-a7fa-69a087b2edb5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:48.902021 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Flavor limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:17:48.902569 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Image limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:17:48.902891 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Flavor pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:17:48.903547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Image pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:17:48.903952 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:17:48.913419 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:48.913862 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:48.914664 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:48.915094 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:48.931497 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Getting quotas for project 4bc69f57ebac4d74adf046561c782bbe. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:17:48.935316 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Getting quotas for user 7d514193abb7427b82557293606d20f6 and project 4bc69f57ebac4d74adf046561c782bbe. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:17:48.945723 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Going to run 1 instances... {{(pid=116570) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:17:48.948007 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:17:48.993110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-02dd4204-8a15-4520-a7fa-69a087b2edb5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:48.993957 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3a1a9f19-cddf-43db-9717-d416cffd2df2 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492371 Feb 21 04:17:48.996796 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 224/463] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:17:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:17:49.003747 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-02dd4204-8a15-4520-a7fa-69a087b2edb5 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1508 microversion: 2.1 time: 0.169251 Feb 21 04:17:49.004507 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2dcc271a-adfd-4a99-81f5-076e4d707935 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:49.005155 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2dcc271a-adfd-4a99-81f5-076e4d707935 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:49.014307 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 240/464] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:48 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:49.020302 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-87738b5f-42f3-495b-9fe6-1c8df1cca195 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:49.021219 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-87738b5f-42f3-495b-9fe6-1c8df1cca195 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:49.035567 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-87738b5f-42f3-495b-9fe6-1c8df1cca195 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:49.036217 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-87738b5f-42f3-495b-9fe6-1c8df1cca195 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:49.037577 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-87738b5f-42f3-495b-9fe6-1c8df1cca195 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:49.038216 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-87738b5f-42f3-495b-9fe6-1c8df1cca195 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:49.061999 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2dcc271a-adfd-4a99-81f5-076e4d707935 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:49.068871 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2dcc271a-adfd-4a99-81f5-076e4d707935 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1214 microversion: 2.1 time: 0.067770 Feb 21 04:17:49.069487 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 225/465] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:49 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:49.073282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-87738b5f-42f3-495b-9fe6-1c8df1cca195 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057682 Feb 21 04:17:49.073941 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 241/466] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:49 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:49.595519 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-54230b46-93fd-454c-a991-98766924e4ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47a59b31-c36d-4858-99e9-315432c3710a", "device": "/dev/sdb"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:49.597267 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-54230b46-93fd-454c-a991-98766924e4ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:49.604418 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-54230b46-93fd-454c-a991-98766924e4ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:49.604904 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-54230b46-93fd-454c-a991-98766924e4ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:49.605687 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-54230b46-93fd-454c-a991-98766924e4ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:49.606120 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-54230b46-93fd-454c-a991-98766924e4ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:49.840884 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-54230b46-93fd-454c-a991-98766924e4ed tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "POST /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248884 Feb 21 04:17:49.841644 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 226/467] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:17:49 2022] POST /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:17:50.020898 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c2a282a8-a135-460f-9c7c-2f3006cbf274 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:50.021427 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c2a282a8-a135-460f-9c7c-2f3006cbf274 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:50.027692 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c2a282a8-a135-460f-9c7c-2f3006cbf274 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:50.028406 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c2a282a8-a135-460f-9c7c-2f3006cbf274 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:50.029213 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c2a282a8-a135-460f-9c7c-2f3006cbf274 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:50.029648 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c2a282a8-a135-460f-9c7c-2f3006cbf274 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:50.085318 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a84901a7-85f7-4a14-ad4c-1775b151df92 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:50.086984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a84901a7-85f7-4a14-ad4c-1775b151df92 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:50.093569 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a84901a7-85f7-4a14-ad4c-1775b151df92 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:50.094024 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a84901a7-85f7-4a14-ad4c-1775b151df92 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:50.094811 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a84901a7-85f7-4a14-ad4c-1775b151df92 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:50.095262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a84901a7-85f7-4a14-ad4c-1775b151df92 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:50.123990 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a84901a7-85f7-4a14-ad4c-1775b151df92 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042746 Feb 21 04:17:50.124562 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 227/468] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:17:50 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 04:17:50.129431 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-425654c8-ebf6-45b0-bd4e-7c60d93b87ad tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:50.130048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-425654c8-ebf6-45b0-bd4e-7c60d93b87ad tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:50.137223 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-425654c8-ebf6-45b0-bd4e-7c60d93b87ad tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:50.137744 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-425654c8-ebf6-45b0-bd4e-7c60d93b87ad tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:50.138649 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-425654c8-ebf6-45b0-bd4e-7c60d93b87ad tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:50.139048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-425654c8-ebf6-45b0-bd4e-7c60d93b87ad tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:50.217954 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-425654c8-ebf6-45b0-bd4e-7c60d93b87ad tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:50.224277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c2a282a8-a135-460f-9c7c-2f3006cbf274 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:50.227043 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-425654c8-ebf6-45b0-bd4e-7c60d93b87ad tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1266 microversion: 2.1 time: 0.101457 Feb 21 04:17:50.228443 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 228/469] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:50 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:50.232873 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c2a282a8-a135-460f-9c7c-2f3006cbf274 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1508 microversion: 2.1 time: 0.215562 Feb 21 04:17:50.242810 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 242/470] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:50 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:50.284724 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-457568780", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "networks": [{"uuid": "0e926c3e-9f0b-4575-b2e7-0a1f391618f8"}]}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:50.339880 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.network.neutron [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] validate_networks() for [('0e926c3e-9f0b-4575-b2e7-0a1f391618f8', None, None, None, None, None)] {{(pid=116570) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:17:51.176524 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-1ba1b7dd-325c-4b81-905f-c1ca94ae9d0a req-034b18b8-a191-4f0f-94fe-e33ece819635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08569093-3abd-43da-8dc2-605b9a289ccf", "name": "network-vif-deleted", "tag": "18fcec87-d164-4874-b7ec-0a2d9c6fb0df"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:51.179337 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:17:51.179337 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:17:51.187420 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-1ba1b7dd-325c-4b81-905f-c1ca94ae9d0a req-034b18b8-a191-4f0f-94fe-e33ece819635 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:51.188395 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-1ba1b7dd-325c-4b81-905f-c1ca94ae9d0a req-034b18b8-a191-4f0f-94fe-e33ece819635 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:51.188885 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Flavor limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:17:51.189360 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Image limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:17:51.189984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Flavor pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:17:51.190905 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Image pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:17:51.191329 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:17:51.205748 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-1ba1b7dd-325c-4b81-905f-c1ca94ae9d0a req-034b18b8-a191-4f0f-94fe-e33ece819635 service nova] Creating event network-vif-deleted:18fcec87-d164-4874-b7ec-0a2d9c6fb0df for instance 08569093-3abd-43da-8dc2-605b9a289ccf on hv-cinder-77398 Feb 21 04:17:51.209738 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:51.210178 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:51.210976 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:51.211406 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:51.226110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-1ba1b7dd-325c-4b81-905f-c1ca94ae9d0a req-034b18b8-a191-4f0f-94fe-e33ece819635 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055891 Feb 21 04:17:51.227376 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 243/471] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:17:51.231630 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Getting quotas for project a0b65910b0574d41970df84e6a1fdbba. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:17:51.235524 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Getting quotas for user 0eea911774944fa2bdb292719f9e2a54 and project a0b65910b0574d41970df84e6a1fdbba. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:17:51.247189 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6b7b54ac-55f3-4176-a451-d0004ab71165 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:51.248376 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6b7b54ac-55f3-4176-a451-d0004ab71165 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:51.248492 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Going to run 1 instances... {{(pid=116570) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:17:51.250793 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:17:51.259672 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6b7b54ac-55f3-4176-a451-d0004ab71165 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:51.260130 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6b7b54ac-55f3-4176-a451-d0004ab71165 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:51.261463 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6b7b54ac-55f3-4176-a451-d0004ab71165 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:51.261905 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6b7b54ac-55f3-4176-a451-d0004ab71165 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:51.311889 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d5f3888a-d02f-43c5-86ca-0202268e2627 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031594 Feb 21 04:17:51.312453 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 229/472] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 04:17:51.322634 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ffe89fb1-fc2c-4f6c-a1a5-b8a1042e2699 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:51.323312 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ffe89fb1-fc2c-4f6c-a1a5-b8a1042e2699 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:51.330994 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ffe89fb1-fc2c-4f6c-a1a5-b8a1042e2699 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:51.345828 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ffe89fb1-fc2c-4f6c-a1a5-b8a1042e2699 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:51.349724 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ffe89fb1-fc2c-4f6c-a1a5-b8a1042e2699 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:51.350244 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ffe89fb1-fc2c-4f6c-a1a5-b8a1042e2699 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:51.385857 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ffe89fb1-fc2c-4f6c-a1a5-b8a1042e2699 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:51.386516 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ffe89fb1-fc2c-4f6c-a1a5-b8a1042e2699 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:51.387261 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-ffe89fb1-fc2c-4f6c-a1a5-b8a1042e2699 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lazy-loading 'fault' on Instance uuid 08569093-3abd-43da-8dc2-605b9a289ccf {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:17:51.442144 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ffe89fb1-fc2c-4f6c-a1a5-b8a1042e2699 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:51.450463 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ffe89fb1-fc2c-4f6c-a1a5-b8a1042e2699 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 200 len: 1312 microversion: 2.1 time: 0.132594 Feb 21 04:17:51.452664 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 230/473] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:51 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 1312 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:51.461076 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c4d444ff-ceeb-4f4f-9238-1da2b57ce48c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:51.462256 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c4d444ff-ceeb-4f4f-9238-1da2b57ce48c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:51.479550 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6b7b54ac-55f3-4176-a451-d0004ab71165 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:51.495186 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6b7b54ac-55f3-4176-a451-d0004ab71165 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.253195 Feb 21 04:17:51.495769 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 244/474] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:51 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:51.535664 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c4d444ff-ceeb-4f4f-9238-1da2b57ce48c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:51.543414 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c4d444ff-ceeb-4f4f-9238-1da2b57ce48c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1217 microversion: 2.1 time: 0.089746 Feb 21 04:17:51.553089 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 231/475] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:51 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:51.864650 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-93d5849b-5d60-46bb-a509-b215a91a3c32 req-70984ce4-451c-4dff-b1cc-64d4351dad0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ebbdc95-a06a-4deb-91be-ec6dba910154", "tag": "913f4d70-2639-4ffc-8df0-8502ed8fa105"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:51.867102 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:17:51.867102 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:17:51.875460 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-93d5849b-5d60-46bb-a509-b215a91a3c32 req-70984ce4-451c-4dff-b1cc-64d4351dad0c service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:51.875912 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-93d5849b-5d60-46bb-a509-b215a91a3c32 req-70984ce4-451c-4dff-b1cc-64d4351dad0c service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:51.887365 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-93d5849b-5d60-46bb-a509-b215a91a3c32 req-70984ce4-451c-4dff-b1cc-64d4351dad0c service nova] Creating event network-changed:913f4d70-2639-4ffc-8df0-8502ed8fa105 for instance 9ebbdc95-a06a-4deb-91be-ec6dba910154 on hv-cinder-77398 Feb 21 04:17:51.893127 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-93d5849b-5d60-46bb-a509-b215a91a3c32 req-70984ce4-451c-4dff-b1cc-64d4351dad0c service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032907 Feb 21 04:17:51.894099 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 245/476] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:52.468682 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-79360498-fd91-432a-909e-26536d0e10be tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:52.469357 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-79360498-fd91-432a-909e-26536d0e10be tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 08569093-3abd-43da-8dc2-605b9a289ccf] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:52.477499 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-79360498-fd91-432a-909e-26536d0e10be tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:52.477961 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-79360498-fd91-432a-909e-26536d0e10be tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:52.478812 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-79360498-fd91-432a-909e-26536d0e10be tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:52.479253 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-79360498-fd91-432a-909e-26536d0e10be tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:52.492666 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-79360498-fd91-432a-909e-26536d0e10be tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] HTTP exception thrown: Instance 08569093-3abd-43da-8dc2-605b9a289ccf could not be found. Feb 21 04:17:52.493252 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-79360498-fd91-432a-909e-26536d0e10be tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Returning 404 to user: Instance 08569093-3abd-43da-8dc2-605b9a289ccf could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:17:52.494070 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-79360498-fd91-432a-909e-26536d0e10be tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf" status: 404 len: 111 microversion: 2.1 time: 0.029164 Feb 21 04:17:52.494606 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 232/477] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:52 2022] GET /compute/v2.1/servers/08569093-3abd-43da-8dc2-605b9a289ccf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:17:52.504343 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-500391d0-87d0-4528-b74b-e8718f8c129a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:52.505780 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-500391d0-87d0-4528-b74b-e8718f8c129a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:52.513260 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-144c6c53-93a5-4cfe-bd21-5f7f3a220282 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:52.513664 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-500391d0-87d0-4528-b74b-e8718f8c129a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:52.513865 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-144c6c53-93a5-4cfe-bd21-5f7f3a220282 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:52.515535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-500391d0-87d0-4528-b74b-e8718f8c129a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:52.515535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-500391d0-87d0-4528-b74b-e8718f8c129a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:52.515535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-500391d0-87d0-4528-b74b-e8718f8c129a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:52.523100 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-144c6c53-93a5-4cfe-bd21-5f7f3a220282 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:52.523601 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-144c6c53-93a5-4cfe-bd21-5f7f3a220282 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:52.524383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-144c6c53-93a5-4cfe-bd21-5f7f3a220282 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:52.525057 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-144c6c53-93a5-4cfe-bd21-5f7f3a220282 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:52.548260 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-500391d0-87d0-4528-b74b-e8718f8c129a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Going to try to terminate instance {{(pid=116571) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:17:52.644690 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-500391d0-87d0-4528-b74b-e8718f8c129a tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "DELETE /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 204 len: 0 microversion: 2.1 time: 0.144649 Feb 21 04:17:52.645646 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 246/478] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:17:52 2022] DELETE /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:17:52.654381 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0b5e6b2c-ed28-4ca5-89a5-744230f44082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:52.655340 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0b5e6b2c-ed28-4ca5-89a5-744230f44082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:52.662401 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0b5e6b2c-ed28-4ca5-89a5-744230f44082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:52.663116 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0b5e6b2c-ed28-4ca5-89a5-744230f44082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:52.664054 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0b5e6b2c-ed28-4ca5-89a5-744230f44082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:52.664666 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0b5e6b2c-ed28-4ca5-89a5-744230f44082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:52.777310 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0b5e6b2c-ed28-4ca5-89a5-744230f44082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:52.785776 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0b5e6b2c-ed28-4ca5-89a5-744230f44082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1277 microversion: 2.1 time: 0.138336 Feb 21 04:17:52.786614 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 247/479] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:52 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:52.794783 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0a64c765-651a-4f78-8328-a4040a2abf06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:52.795506 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0a64c765-651a-4f78-8328-a4040a2abf06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:52.807146 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0a64c765-651a-4f78-8328-a4040a2abf06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:52.807838 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0a64c765-651a-4f78-8328-a4040a2abf06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:52.809070 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0a64c765-651a-4f78-8328-a4040a2abf06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:52.810363 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0a64c765-651a-4f78-8328-a4040a2abf06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:52.854940 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-144c6c53-93a5-4cfe-bd21-5f7f3a220282 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:52.862837 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-144c6c53-93a5-4cfe-bd21-5f7f3a220282 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.353745 Feb 21 04:17:52.863699 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 233/480] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:52 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:53.054686 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0a64c765-651a-4f78-8328-a4040a2abf06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:53.064546 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0a64c765-651a-4f78-8328-a4040a2abf06 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.273331 Feb 21 04:17:53.076341 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 248/481] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:52 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:53.802919 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9759a114-4b42-477b-8c6d-3f4369de1513 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:53.803532 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9759a114-4b42-477b-8c6d-3f4369de1513 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:53.810150 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9759a114-4b42-477b-8c6d-3f4369de1513 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:53.810648 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9759a114-4b42-477b-8c6d-3f4369de1513 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:53.811425 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9759a114-4b42-477b-8c6d-3f4369de1513 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:53.811953 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9759a114-4b42-477b-8c6d-3f4369de1513 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:53.881427 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ee09c07e-1954-4700-9781-4d552d6fd496 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:53.882908 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ee09c07e-1954-4700-9781-4d552d6fd496 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:53.889995 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ee09c07e-1954-4700-9781-4d552d6fd496 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:53.890445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ee09c07e-1954-4700-9781-4d552d6fd496 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:53.891235 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ee09c07e-1954-4700-9781-4d552d6fd496 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:53.891684 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ee09c07e-1954-4700-9781-4d552d6fd496 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:54.051889 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9759a114-4b42-477b-8c6d-3f4369de1513 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:54.059370 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9759a114-4b42-477b-8c6d-3f4369de1513 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.260106 Feb 21 04:17:54.059938 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 234/482] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:53 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:54.083320 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-467f833c-70db-42c6-b5b9-ae6bf68dc3f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:54.083936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-467f833c-70db-42c6-b5b9-ae6bf68dc3f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:54.089726 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-467f833c-70db-42c6-b5b9-ae6bf68dc3f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:54.090174 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-467f833c-70db-42c6-b5b9-ae6bf68dc3f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:54.090962 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-467f833c-70db-42c6-b5b9-ae6bf68dc3f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:54.091589 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-467f833c-70db-42c6-b5b9-ae6bf68dc3f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:54.184374 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ee09c07e-1954-4700-9781-4d552d6fd496 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:54.192067 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ee09c07e-1954-4700-9781-4d552d6fd496 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.315403 Feb 21 04:17:54.192652 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 249/483] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:53 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:54.273399 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-a05afa5a-9f4c-448e-bc57-cfb31087e125 req-f825f225-5663-4b74-86e0-b19dfa3c679c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f1fe68-8efa-45ce-8c76-671456eca8ec", "tag": "d27cb79f-b2f0-42e8-b1b6-081f71fbfcee"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:17:54.275206 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:17:54.275206 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:17:54.282330 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-a05afa5a-9f4c-448e-bc57-cfb31087e125 req-f825f225-5663-4b74-86e0-b19dfa3c679c service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:54.282774 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-a05afa5a-9f4c-448e-bc57-cfb31087e125 req-f825f225-5663-4b74-86e0-b19dfa3c679c service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:54.293993 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-a05afa5a-9f4c-448e-bc57-cfb31087e125 req-f825f225-5663-4b74-86e0-b19dfa3c679c service nova] Creating event network-changed:d27cb79f-b2f0-42e8-b1b6-081f71fbfcee for instance c8f1fe68-8efa-45ce-8c76-671456eca8ec on hv-cinder-77398 Feb 21 04:17:54.298607 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-a05afa5a-9f4c-448e-bc57-cfb31087e125 req-f825f225-5663-4b74-86e0-b19dfa3c679c service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028897 Feb 21 04:17:54.299197 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 250/484] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:17:54.323974 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-467f833c-70db-42c6-b5b9-ae6bf68dc3f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:54.331195 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-467f833c-70db-42c6-b5b9-ae6bf68dc3f6 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.251951 Feb 21 04:17:54.331763 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 235/485] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:54 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:55.077368 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-19c16dea-8b67-4866-b771-4989c20e8022 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:55.078222 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-19c16dea-8b67-4866-b771-4989c20e8022 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:55.084763 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-19c16dea-8b67-4866-b771-4989c20e8022 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:55.085332 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-19c16dea-8b67-4866-b771-4989c20e8022 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:55.086196 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-19c16dea-8b67-4866-b771-4989c20e8022 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:55.086633 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-19c16dea-8b67-4866-b771-4989c20e8022 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:55.209391 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a4841c17-fcfd-41c6-a219-d46a4970518c tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:55.210153 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a4841c17-fcfd-41c6-a219-d46a4970518c tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:55.217106 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a4841c17-fcfd-41c6-a219-d46a4970518c tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:55.217654 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a4841c17-fcfd-41c6-a219-d46a4970518c tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:55.219101 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a4841c17-fcfd-41c6-a219-d46a4970518c tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:55.219606 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a4841c17-fcfd-41c6-a219-d46a4970518c tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:55.283920 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-19c16dea-8b67-4866-b771-4989c20e8022 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:55.303673 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-19c16dea-8b67-4866-b771-4989c20e8022 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.220800 Feb 21 04:17:55.305054 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 251/486] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:55 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:55.349035 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-aba521f4-ffe3-49bd-9582-2511e3ecc9dd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:55.350048 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-aba521f4-ffe3-49bd-9582-2511e3ecc9dd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:55.356269 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-aba521f4-ffe3-49bd-9582-2511e3ecc9dd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:55.356830 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-aba521f4-ffe3-49bd-9582-2511e3ecc9dd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:55.357631 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-aba521f4-ffe3-49bd-9582-2511e3ecc9dd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:55.358074 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-aba521f4-ffe3-49bd-9582-2511e3ecc9dd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:55.406258 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a4841c17-fcfd-41c6-a219-d46a4970518c tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:55.413399 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a4841c17-fcfd-41c6-a219-d46a4970518c tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.208892 Feb 21 04:17:55.413974 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 236/487] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:55 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:55.495186 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-aba521f4-ffe3-49bd-9582-2511e3ecc9dd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:55.502429 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-aba521f4-ffe3-49bd-9582-2511e3ecc9dd tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.158067 Feb 21 04:17:55.503499 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 252/488] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:55 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:56.320903 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9a5a7a67-300f-40dc-a8b7-16f0f29b70dc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:56.321513 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9a5a7a67-300f-40dc-a8b7-16f0f29b70dc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:56.327423 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9a5a7a67-300f-40dc-a8b7-16f0f29b70dc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:56.327870 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9a5a7a67-300f-40dc-a8b7-16f0f29b70dc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:56.328652 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9a5a7a67-300f-40dc-a8b7-16f0f29b70dc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:56.329099 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9a5a7a67-300f-40dc-a8b7-16f0f29b70dc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:56.430208 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6b0aa12b-da61-4455-857d-50fe4dcb928e tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:56.430812 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6b0aa12b-da61-4455-857d-50fe4dcb928e tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:56.436996 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6b0aa12b-da61-4455-857d-50fe4dcb928e tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:56.437449 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6b0aa12b-da61-4455-857d-50fe4dcb928e tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:56.438222 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6b0aa12b-da61-4455-857d-50fe4dcb928e tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:56.438653 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6b0aa12b-da61-4455-857d-50fe4dcb928e tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:56.457606 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9a5a7a67-300f-40dc-a8b7-16f0f29b70dc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:56.464752 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9a5a7a67-300f-40dc-a8b7-16f0f29b70dc tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.147316 Feb 21 04:17:56.465315 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 237/489] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:56 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:56.519676 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4704b9a9-92f5-4b4f-a5cd-68b336fe985d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:56.520293 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4704b9a9-92f5-4b4f-a5cd-68b336fe985d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:56.526085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4704b9a9-92f5-4b4f-a5cd-68b336fe985d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:56.526531 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4704b9a9-92f5-4b4f-a5cd-68b336fe985d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:56.527300 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4704b9a9-92f5-4b4f-a5cd-68b336fe985d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:56.527729 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4704b9a9-92f5-4b4f-a5cd-68b336fe985d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:56.772542 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6b0aa12b-da61-4455-857d-50fe4dcb928e tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:56.780193 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6b0aa12b-da61-4455-857d-50fe4dcb928e tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.353554 Feb 21 04:17:56.780775 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 253/490] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:56 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:56.857675 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4704b9a9-92f5-4b4f-a5cd-68b336fe985d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:56.864759 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4704b9a9-92f5-4b4f-a5cd-68b336fe985d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.349321 Feb 21 04:17:56.865323 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 238/491] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:56 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:57.481364 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e9817813-847f-4122-8ca8-ae8156675ec8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:57.481973 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e9817813-847f-4122-8ca8-ae8156675ec8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:57.488913 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e9817813-847f-4122-8ca8-ae8156675ec8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:57.489358 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e9817813-847f-4122-8ca8-ae8156675ec8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:57.490130 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e9817813-847f-4122-8ca8-ae8156675ec8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:57.490561 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e9817813-847f-4122-8ca8-ae8156675ec8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:57.621443 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e9817813-847f-4122-8ca8-ae8156675ec8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:57.629422 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e9817813-847f-4122-8ca8-ae8156675ec8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.151699 Feb 21 04:17:57.629986 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 254/492] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:57 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:57.796344 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6b9f588f-399f-4cee-b273-ab10b1d627e6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:57.796986 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6b9f588f-399f-4cee-b273-ab10b1d627e6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:57.803881 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6b9f588f-399f-4cee-b273-ab10b1d627e6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:57.804332 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6b9f588f-399f-4cee-b273-ab10b1d627e6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:57.805138 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6b9f588f-399f-4cee-b273-ab10b1d627e6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:57.805573 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6b9f588f-399f-4cee-b273-ab10b1d627e6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:57.881386 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b8a8c6b9-fdbc-44b3-b993-b7da96f0470d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:57.881994 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b8a8c6b9-fdbc-44b3-b993-b7da96f0470d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:57.887715 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b8a8c6b9-fdbc-44b3-b993-b7da96f0470d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:57.888162 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b8a8c6b9-fdbc-44b3-b993-b7da96f0470d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:57.888961 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b8a8c6b9-fdbc-44b3-b993-b7da96f0470d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:57.889396 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b8a8c6b9-fdbc-44b3-b993-b7da96f0470d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:57.943292 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6b9f588f-399f-4cee-b273-ab10b1d627e6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:57.950491 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6b9f588f-399f-4cee-b273-ab10b1d627e6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.157722 Feb 21 04:17:57.951061 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 239/493] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:57 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:58.027571 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b8a8c6b9-fdbc-44b3-b993-b7da96f0470d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:58.035700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b8a8c6b9-fdbc-44b3-b993-b7da96f0470d tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.157966 Feb 21 04:17:58.036252 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 255/494] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:57 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:58.645999 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7f4276d5-381b-4f35-8459-0d447c452f9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:58.646661 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7f4276d5-381b-4f35-8459-0d447c452f9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:58.652443 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7f4276d5-381b-4f35-8459-0d447c452f9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:58.653173 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7f4276d5-381b-4f35-8459-0d447c452f9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:58.653948 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7f4276d5-381b-4f35-8459-0d447c452f9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:58.654383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7f4276d5-381b-4f35-8459-0d447c452f9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:58.785958 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7f4276d5-381b-4f35-8459-0d447c452f9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:58.793136 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7f4276d5-381b-4f35-8459-0d447c452f9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.151410 Feb 21 04:17:58.793699 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 240/495] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:58 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:58.966993 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c6aa557a-2fca-47ae-a8d0-3a61301d60f0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:58.967521 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c6aa557a-2fca-47ae-a8d0-3a61301d60f0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:58.973787 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c6aa557a-2fca-47ae-a8d0-3a61301d60f0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:58.974229 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c6aa557a-2fca-47ae-a8d0-3a61301d60f0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:58.974990 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c6aa557a-2fca-47ae-a8d0-3a61301d60f0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:58.975418 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c6aa557a-2fca-47ae-a8d0-3a61301d60f0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:59.052797 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-391a81ef-c9a3-43c9-a87b-4cc524f60bf2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:59.053407 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-391a81ef-c9a3-43c9-a87b-4cc524f60bf2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:59.059782 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-391a81ef-c9a3-43c9-a87b-4cc524f60bf2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:59.060232 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-391a81ef-c9a3-43c9-a87b-4cc524f60bf2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:59.061037 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-391a81ef-c9a3-43c9-a87b-4cc524f60bf2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:59.061478 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-391a81ef-c9a3-43c9-a87b-4cc524f60bf2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:59.113575 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c6aa557a-2fca-47ae-a8d0-3a61301d60f0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:59.120848 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c6aa557a-2fca-47ae-a8d0-3a61301d60f0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.157585 Feb 21 04:17:59.121410 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 256/496] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:58 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:17:59.201489 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-391a81ef-c9a3-43c9-a87b-4cc524f60bf2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:59.208541 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-391a81ef-c9a3-43c9-a87b-4cc524f60bf2 tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.159953 Feb 21 04:17:59.209133 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 241/497] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:59 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:17:59.809151 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-92fea7b4-eea1-48a5-ba8a-1989ebbe0712 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:17:59.809757 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-92fea7b4-eea1-48a5-ba8a-1989ebbe0712 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:17:59.815623 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-92fea7b4-eea1-48a5-ba8a-1989ebbe0712 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:59.816071 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-92fea7b4-eea1-48a5-ba8a-1989ebbe0712 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:59.816870 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-92fea7b4-eea1-48a5-ba8a-1989ebbe0712 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:17:59.817303 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-92fea7b4-eea1-48a5-ba8a-1989ebbe0712 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:17:59.948000 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-92fea7b4-eea1-48a5-ba8a-1989ebbe0712 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:17:59.955152 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-92fea7b4-eea1-48a5-ba8a-1989ebbe0712 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.149620 Feb 21 04:17:59.955712 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 257/498] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:17:59 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:00.137053 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9cbcad30-f427-45b0-8e77-c6253d5796b0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:00.137658 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9cbcad30-f427-45b0-8e77-c6253d5796b0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:00.144525 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9cbcad30-f427-45b0-8e77-c6253d5796b0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:00.144989 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9cbcad30-f427-45b0-8e77-c6253d5796b0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:00.145757 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9cbcad30-f427-45b0-8e77-c6253d5796b0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:00.146178 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9cbcad30-f427-45b0-8e77-c6253d5796b0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:00.225353 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ba16fa19-e935-429a-ba3c-65253f82ecde tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:00.225920 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ba16fa19-e935-429a-ba3c-65253f82ecde tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:00.232809 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ba16fa19-e935-429a-ba3c-65253f82ecde tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:00.232809 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ba16fa19-e935-429a-ba3c-65253f82ecde tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:00.233338 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ba16fa19-e935-429a-ba3c-65253f82ecde tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:00.233776 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ba16fa19-e935-429a-ba3c-65253f82ecde tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:00.329820 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9cbcad30-f427-45b0-8e77-c6253d5796b0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:00.336971 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9cbcad30-f427-45b0-8e77-c6253d5796b0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.203372 Feb 21 04:18:00.337597 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 242/499] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:00 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:00.393736 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ba16fa19-e935-429a-ba3c-65253f82ecde tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:00.401058 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ba16fa19-e935-429a-ba3c-65253f82ecde tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.179411 Feb 21 04:18:00.403293 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 258/500] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:00 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:00.972499 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e772a278-c074-4ddb-9be1-63d8560fc656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:00.973138 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e772a278-c074-4ddb-9be1-63d8560fc656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:00.979013 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e772a278-c074-4ddb-9be1-63d8560fc656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:00.979463 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e772a278-c074-4ddb-9be1-63d8560fc656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:00.980242 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e772a278-c074-4ddb-9be1-63d8560fc656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:00.980704 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e772a278-c074-4ddb-9be1-63d8560fc656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:01.110370 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e772a278-c074-4ddb-9be1-63d8560fc656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:01.117536 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e772a278-c074-4ddb-9be1-63d8560fc656 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.149182 Feb 21 04:18:01.118097 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 243/501] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:00 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:01.339031 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7356414d-69d7-4071-946e-9c6fee028520 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:01.340201 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7356414d-69d7-4071-946e-9c6fee028520 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:01.346354 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7356414d-69d7-4071-946e-9c6fee028520 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:01.347556 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7356414d-69d7-4071-946e-9c6fee028520 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:01.348956 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7356414d-69d7-4071-946e-9c6fee028520 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:01.349598 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7356414d-69d7-4071-946e-9c6fee028520 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:01.353241 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-93ab7fab-71c4-40e1-9001-66557a80d4ba tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:01.353849 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-93ab7fab-71c4-40e1-9001-66557a80d4ba tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:01.360504 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-93ab7fab-71c4-40e1-9001-66557a80d4ba tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:01.361204 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-93ab7fab-71c4-40e1-9001-66557a80d4ba tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:01.362244 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-93ab7fab-71c4-40e1-9001-66557a80d4ba tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:01.362846 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-93ab7fab-71c4-40e1-9001-66557a80d4ba tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:01.373444 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-7356414d-69d7-4071-946e-9c6fee028520 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lazy-loading 'flavor' on Instance uuid c0c59a20-ff75-456f-99b3-070207d951d7 {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:18:01.510433 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-93ab7fab-71c4-40e1-9001-66557a80d4ba tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:01.517799 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-93ab7fab-71c4-40e1-9001-66557a80d4ba tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.168121 Feb 21 04:18:01.519184 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 244/502] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:01 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:01.523200 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d361f64c-e663-464f-88fd-31493b640f1b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:01.523866 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d361f64c-e663-464f-88fd-31493b640f1b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:01.530073 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d361f64c-e663-464f-88fd-31493b640f1b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:01.530590 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d361f64c-e663-464f-88fd-31493b640f1b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:01.531602 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d361f64c-e663-464f-88fd-31493b640f1b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:01.532106 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d361f64c-e663-464f-88fd-31493b640f1b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:01.661047 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7356414d-69d7-4071-946e-9c6fee028520 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "POST /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/action" status: 202 len: 0 microversion: 2.20 time: 0.325634 Feb 21 04:18:01.661982 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 259/503] 10.222.0.10 () {62 vars in 1318 bytes} [Mon Feb 21 04:18:01 2022] POST /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:18:01.670208 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-49b01074-9d29-4c98-b70d-705abdbec607 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:01.671373 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-49b01074-9d29-4c98-b70d-705abdbec607 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:01.680244 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-49b01074-9d29-4c98-b70d-705abdbec607 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:01.681020 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-49b01074-9d29-4c98-b70d-705abdbec607 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:01.682026 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-49b01074-9d29-4c98-b70d-705abdbec607 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:01.682717 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-49b01074-9d29-4c98-b70d-705abdbec607 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:01.690987 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d361f64c-e663-464f-88fd-31493b640f1b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:01.701231 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d361f64c-e663-464f-88fd-31493b640f1b tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1521 microversion: 2.1 time: 0.180301 Feb 21 04:18:01.702314 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 245/504] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:01 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:01.841468 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-49b01074-9d29-4c98-b70d-705abdbec607 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:01.849056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-49b01074-9d29-4c98-b70d-705abdbec607 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:01.851656 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-49b01074-9d29-4c98-b70d-705abdbec607 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:01.853611 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-49b01074-9d29-4c98-b70d-705abdbec607 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.187235 Feb 21 04:18:01.854599 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 260/505] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:01 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:02.134690 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e81d2ede-db40-4307-b6ad-43b642c1ce4e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:02.135398 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e81d2ede-db40-4307-b6ad-43b642c1ce4e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:02.141859 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e81d2ede-db40-4307-b6ad-43b642c1ce4e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:02.142497 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e81d2ede-db40-4307-b6ad-43b642c1ce4e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:02.143547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e81d2ede-db40-4307-b6ad-43b642c1ce4e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:02.144141 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e81d2ede-db40-4307-b6ad-43b642c1ce4e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:02.376209 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-337fbc92-d703-460e-ac36-1d2810b2866c req-1c91fc4e-17a9-495e-a453-f0440937b29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c2ec47-cdd2-4f7a-a523-8afdb8f2656d", "name": "network-vif-deleted", "tag": "9dcd026b-bef5-4076-bab8-0b8c1cff42f3"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:02.377795 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:18:02.377795 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:18:02.385929 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-337fbc92-d703-460e-ac36-1d2810b2866c req-1c91fc4e-17a9-495e-a453-f0440937b29e service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:02.386379 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-337fbc92-d703-460e-ac36-1d2810b2866c req-1c91fc4e-17a9-495e-a453-f0440937b29e service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:02.398256 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-337fbc92-d703-460e-ac36-1d2810b2866c req-1c91fc4e-17a9-495e-a453-f0440937b29e service nova] Creating event network-vif-deleted:9dcd026b-bef5-4076-bab8-0b8c1cff42f3 for instance 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d on hv-cinder-77398 Feb 21 04:18:02.402785 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e81d2ede-db40-4307-b6ad-43b642c1ce4e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:02.405404 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-337fbc92-d703-460e-ac36-1d2810b2866c req-1c91fc4e-17a9-495e-a453-f0440937b29e service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031647 Feb 21 04:18:02.406005 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 261/506] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:02.411822 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e81d2ede-db40-4307-b6ad-43b642c1ce4e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.281012 Feb 21 04:18:02.412386 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 246/507] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:02 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:02.537555 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-31a9686d-e852-4946-a69c-3bbb299fd1d0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:02.538245 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-31a9686d-e852-4946-a69c-3bbb299fd1d0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:02.544321 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-31a9686d-e852-4946-a69c-3bbb299fd1d0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:02.544819 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-31a9686d-e852-4946-a69c-3bbb299fd1d0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:02.545583 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-31a9686d-e852-4946-a69c-3bbb299fd1d0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:02.546010 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-31a9686d-e852-4946-a69c-3bbb299fd1d0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:02.683417 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-31a9686d-e852-4946-a69c-3bbb299fd1d0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:02.690507 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-31a9686d-e852-4946-a69c-3bbb299fd1d0 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.158861 Feb 21 04:18:02.691056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 262/508] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:02 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:02.718623 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5a2ff089-b13c-40ca-a67b-1767d37d57cc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:02.719233 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5a2ff089-b13c-40ca-a67b-1767d37d57cc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:02.725633 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a2ff089-b13c-40ca-a67b-1767d37d57cc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:02.726077 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a2ff089-b13c-40ca-a67b-1767d37d57cc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:02.726850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a2ff089-b13c-40ca-a67b-1767d37d57cc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:02.727281 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a2ff089-b13c-40ca-a67b-1767d37d57cc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:02.756462 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a2ff089-b13c-40ca-a67b-1767d37d57cc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:02.756950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a2ff089-b13c-40ca-a67b-1767d37d57cc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:02.757393 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-5a2ff089-b13c-40ca-a67b-1767d37d57cc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lazy-loading 'fault' on Instance uuid 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:18:02.797110 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5a2ff089-b13c-40ca-a67b-1767d37d57cc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d6410449484671b517b6d671ed6576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa414febea2c4d4eb40898c7b119111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:02.804403 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5a2ff089-b13c-40ca-a67b-1767d37d57cc tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 200 len: 1312 microversion: 2.1 time: 0.089463 Feb 21 04:18:02.805000 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 247/509] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:02 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:02.872341 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4373b9fd-a88d-4ea7-af71-32de7cd01c76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:02.872909 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4373b9fd-a88d-4ea7-af71-32de7cd01c76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:02.879138 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4373b9fd-a88d-4ea7-af71-32de7cd01c76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:02.879580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4373b9fd-a88d-4ea7-af71-32de7cd01c76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:02.880339 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4373b9fd-a88d-4ea7-af71-32de7cd01c76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:02.880797 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4373b9fd-a88d-4ea7-af71-32de7cd01c76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:03.030150 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4373b9fd-a88d-4ea7-af71-32de7cd01c76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:03.039751 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4373b9fd-a88d-4ea7-af71-32de7cd01c76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:03.042160 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4373b9fd-a88d-4ea7-af71-32de7cd01c76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:03.044061 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4373b9fd-a88d-4ea7-af71-32de7cd01c76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.175231 Feb 21 04:18:03.044975 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 263/510] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:02 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:03.428796 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-da6b46cb-e691-401c-997c-702ce12fadaa tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:03.429408 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-da6b46cb-e691-401c-997c-702ce12fadaa tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:03.435627 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-da6b46cb-e691-401c-997c-702ce12fadaa tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:03.436074 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-da6b46cb-e691-401c-997c-702ce12fadaa tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:03.436876 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-da6b46cb-e691-401c-997c-702ce12fadaa tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:03.437310 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-da6b46cb-e691-401c-997c-702ce12fadaa tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:03.569954 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-da6b46cb-e691-401c-997c-702ce12fadaa tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:03.577149 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-da6b46cb-e691-401c-997c-702ce12fadaa tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.152550 Feb 21 04:18:03.577717 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 248/511] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:03 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:03.706713 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-db155b14-4327-4998-985d-f49351b76b06 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:03.707322 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-db155b14-4327-4998-985d-f49351b76b06 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:03.713472 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-db155b14-4327-4998-985d-f49351b76b06 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:03.713918 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-db155b14-4327-4998-985d-f49351b76b06 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:03.714689 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-db155b14-4327-4998-985d-f49351b76b06 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:03.715120 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-db155b14-4327-4998-985d-f49351b76b06 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:03.820920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-028169be-b3ba-431d-b7b2-23dab9cf21ee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:03.821532 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-028169be-b3ba-431d-b7b2-23dab9cf21ee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] [instance: 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:03.827621 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-028169be-b3ba-431d-b7b2-23dab9cf21ee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:03.827621 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-028169be-b3ba-431d-b7b2-23dab9cf21ee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:03.828415 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-028169be-b3ba-431d-b7b2-23dab9cf21ee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:03.828889 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-028169be-b3ba-431d-b7b2-23dab9cf21ee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:03.841820 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-028169be-b3ba-431d-b7b2-23dab9cf21ee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] HTTP exception thrown: Instance 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d could not be found. Feb 21 04:18:03.842408 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-028169be-b3ba-431d-b7b2-23dab9cf21ee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] Returning 404 to user: Instance 26c2ec47-cdd2-4f7a-a523-8afdb8f2656d could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:03.843226 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-028169be-b3ba-431d-b7b2-23dab9cf21ee tempest-ServerRescueNegativeTestJSON-1447798752 tempest-ServerRescueNegativeTestJSON-1447798752-project] 10.222.0.10 "GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d" status: 404 len: 111 microversion: 2.1 time: 0.025939 Feb 21 04:18:03.843769 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 249/512] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:03 2022] GET /compute/v2.1/servers/26c2ec47-cdd2-4f7a-a523-8afdb8f2656d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:18:03.845957 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-db155b14-4327-4998-985d-f49351b76b06 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:03.853715 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-db155b14-4327-4998-985d-f49351b76b06 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.150497 Feb 21 04:18:03.854276 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 264/513] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:03 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:04.062466 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4b9ecf6b-4079-408f-99ed-b77ac1595942 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:04.063111 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4b9ecf6b-4079-408f-99ed-b77ac1595942 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:04.069934 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4b9ecf6b-4079-408f-99ed-b77ac1595942 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:04.070383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4b9ecf6b-4079-408f-99ed-b77ac1595942 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:04.071696 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4b9ecf6b-4079-408f-99ed-b77ac1595942 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:04.072144 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4b9ecf6b-4079-408f-99ed-b77ac1595942 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:04.315689 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4b9ecf6b-4079-408f-99ed-b77ac1595942 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:04.323361 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4b9ecf6b-4079-408f-99ed-b77ac1595942 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:04.324967 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4b9ecf6b-4079-408f-99ed-b77ac1595942 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:04.326188 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4b9ecf6b-4079-408f-99ed-b77ac1595942 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.267528 Feb 21 04:18:04.326810 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 250/514] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:04 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:04.593789 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0e8c799a-89c3-4c9c-bcd1-c6176ac919e2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:04.594331 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0e8c799a-89c3-4c9c-bcd1-c6176ac919e2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:04.600113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0e8c799a-89c3-4c9c-bcd1-c6176ac919e2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:04.600566 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0e8c799a-89c3-4c9c-bcd1-c6176ac919e2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:04.601380 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0e8c799a-89c3-4c9c-bcd1-c6176ac919e2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:04.601817 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0e8c799a-89c3-4c9c-bcd1-c6176ac919e2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:04.837963 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0e8c799a-89c3-4c9c-bcd1-c6176ac919e2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:04.845601 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0e8c799a-89c3-4c9c-bcd1-c6176ac919e2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.255563 Feb 21 04:18:04.846200 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 265/515] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:04 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:04.869742 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-389bb0c4-44cb-49ca-9cc9-25808a44df49 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:04.870353 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-389bb0c4-44cb-49ca-9cc9-25808a44df49 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:04.876586 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-389bb0c4-44cb-49ca-9cc9-25808a44df49 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:04.877063 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-389bb0c4-44cb-49ca-9cc9-25808a44df49 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:04.878485 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-389bb0c4-44cb-49ca-9cc9-25808a44df49 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:04.878916 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-389bb0c4-44cb-49ca-9cc9-25808a44df49 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:05.122377 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-389bb0c4-44cb-49ca-9cc9-25808a44df49 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:05.132318 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-389bb0c4-44cb-49ca-9cc9-25808a44df49 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.266152 Feb 21 04:18:05.132931 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 251/516] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:04 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:05.344453 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-cc31a5ff-4ff8-4340-9c0b-476f9b484528 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:05.345229 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-cc31a5ff-4ff8-4340-9c0b-476f9b484528 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:05.353995 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cc31a5ff-4ff8-4340-9c0b-476f9b484528 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:05.354634 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cc31a5ff-4ff8-4340-9c0b-476f9b484528 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:05.355443 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cc31a5ff-4ff8-4340-9c0b-476f9b484528 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:05.355881 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cc31a5ff-4ff8-4340-9c0b-476f9b484528 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:05.811104 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-cc31a5ff-4ff8-4340-9c0b-476f9b484528 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:05.819036 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-cc31a5ff-4ff8-4340-9c0b-476f9b484528 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:05.820532 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-cc31a5ff-4ff8-4340-9c0b-476f9b484528 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:05.821739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-cc31a5ff-4ff8-4340-9c0b-476f9b484528 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.480937 Feb 21 04:18:05.822291 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 266/517] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:05 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:05.865541 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d587ad60-0343-4732-9854-20810de91a9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:05.866776 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d587ad60-0343-4732-9854-20810de91a9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:05.872965 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d587ad60-0343-4732-9854-20810de91a9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:05.873560 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d587ad60-0343-4732-9854-20810de91a9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:05.874291 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d587ad60-0343-4732-9854-20810de91a9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:05.875228 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d587ad60-0343-4732-9854-20810de91a9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:06.119490 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d587ad60-0343-4732-9854-20810de91a9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:06.126868 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d587ad60-0343-4732-9854-20810de91a9f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.265096 Feb 21 04:18:06.128126 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 252/518] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:05 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:06.148452 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-79f940a5-c587-4f9a-838b-1672ab2f2ead tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:06.149225 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-79f940a5-c587-4f9a-838b-1672ab2f2ead tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:06.155372 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79f940a5-c587-4f9a-838b-1672ab2f2ead tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:06.155823 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79f940a5-c587-4f9a-838b-1672ab2f2ead tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:06.156671 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79f940a5-c587-4f9a-838b-1672ab2f2ead tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:06.157266 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79f940a5-c587-4f9a-838b-1672ab2f2ead tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:06.398896 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-79f940a5-c587-4f9a-838b-1672ab2f2ead tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:06.406237 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-79f940a5-c587-4f9a-838b-1672ab2f2ead tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.261424 Feb 21 04:18:06.406793 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 267/519] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:06 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:06.841338 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-87f6771c-fea0-4e85-a185-b110dce187af tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:06.841946 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-87f6771c-fea0-4e85-a185-b110dce187af tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:06.848253 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-87f6771c-fea0-4e85-a185-b110dce187af tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:06.848732 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-87f6771c-fea0-4e85-a185-b110dce187af tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:06.849511 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-87f6771c-fea0-4e85-a185-b110dce187af tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:06.849942 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-87f6771c-fea0-4e85-a185-b110dce187af tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:06.987495 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-87f6771c-fea0-4e85-a185-b110dce187af tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:06.995336 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-87f6771c-fea0-4e85-a185-b110dce187af tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:06.996877 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-87f6771c-fea0-4e85-a185-b110dce187af tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:06.998392 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-87f6771c-fea0-4e85-a185-b110dce187af tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.160739 Feb 21 04:18:06.999385 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 253/520] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:06 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:18:07.144800 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7c1fa97b-5843-497e-a85e-574598ddf154 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:07.145758 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7c1fa97b-5843-497e-a85e-574598ddf154 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:07.154654 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7c1fa97b-5843-497e-a85e-574598ddf154 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:07.155652 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7c1fa97b-5843-497e-a85e-574598ddf154 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:07.156840 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7c1fa97b-5843-497e-a85e-574598ddf154 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:07.157515 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7c1fa97b-5843-497e-a85e-574598ddf154 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:07.379184 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7c1fa97b-5843-497e-a85e-574598ddf154 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:07.387906 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7c1fa97b-5843-497e-a85e-574598ddf154 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.247459 Feb 21 04:18:07.388484 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 268/521] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:07 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:07.421886 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-648fc550-3d31-4758-9da7-dbbbbd6f0007 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:07.422523 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-648fc550-3d31-4758-9da7-dbbbbd6f0007 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:07.428411 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-648fc550-3d31-4758-9da7-dbbbbd6f0007 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:07.429028 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-648fc550-3d31-4758-9da7-dbbbbd6f0007 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:07.429850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-648fc550-3d31-4758-9da7-dbbbbd6f0007 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:07.430289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-648fc550-3d31-4758-9da7-dbbbbd6f0007 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:07.592786 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-648fc550-3d31-4758-9da7-dbbbbd6f0007 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:07.600021 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-648fc550-3d31-4758-9da7-dbbbbd6f0007 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.181840 Feb 21 04:18:07.600603 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 254/522] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:07 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:08.016468 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-70eb4a16-440a-452d-a40a-626a0bfed8e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:08.017183 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-70eb4a16-440a-452d-a40a-626a0bfed8e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:08.022938 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-70eb4a16-440a-452d-a40a-626a0bfed8e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:08.023385 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-70eb4a16-440a-452d-a40a-626a0bfed8e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:08.024150 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-70eb4a16-440a-452d-a40a-626a0bfed8e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:08.024581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-70eb4a16-440a-452d-a40a-626a0bfed8e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:08.172795 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-70eb4a16-440a-452d-a40a-626a0bfed8e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:08.181880 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-70eb4a16-440a-452d-a40a-626a0bfed8e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:08.183371 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-70eb4a16-440a-452d-a40a-626a0bfed8e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:08.184517 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-70eb4a16-440a-452d-a40a-626a0bfed8e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.171697 Feb 21 04:18:08.185091 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 269/523] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:08 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:08.405338 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-85056b2b-b5a3-4f06-8371-a800378c99ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:08.405942 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-85056b2b-b5a3-4f06-8371-a800378c99ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:08.412192 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-85056b2b-b5a3-4f06-8371-a800378c99ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:08.412668 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-85056b2b-b5a3-4f06-8371-a800378c99ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:08.413457 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-85056b2b-b5a3-4f06-8371-a800378c99ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:08.413892 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-85056b2b-b5a3-4f06-8371-a800378c99ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:08.498940 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-adea3d55-41e7-4b3a-b4c7-c4b129453e80 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Action: 'create', calling method: .version_select at 0x7feee1518dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1608806341"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:08.545278 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-85056b2b-b5a3-4f06-8371-a800378c99ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:08.552578 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-85056b2b-b5a3-4f06-8371-a800378c99ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.151199 Feb 21 04:18:08.553604 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 270/524] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:08 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:08.616429 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c45f23c9-8282-49c4-8def-713c61841406 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:08.617054 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c45f23c9-8282-49c4-8def-713c61841406 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:08.622876 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c45f23c9-8282-49c4-8def-713c61841406 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:08.623318 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c45f23c9-8282-49c4-8def-713c61841406 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:08.624083 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c45f23c9-8282-49c4-8def-713c61841406 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:08.624509 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c45f23c9-8282-49c4-8def-713c61841406 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:08.773644 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c45f23c9-8282-49c4-8def-713c61841406 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:08.783382 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c45f23c9-8282-49c4-8def-713c61841406 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.170171 Feb 21 04:18:08.786669 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-adea3d55-41e7-4b3a-b4c7-c4b129453e80 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.425558 Feb 21 04:18:08.787280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 255/525] 10.222.0.10 () {60 vars in 1154 bytes} [Mon Feb 21 04:18:08 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 427 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 21 04:18:08.793274 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 271/526] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:08 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:08.800845 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e35c0235-fcb8-47ce-9954-2cda331474fd tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee1632790>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:08.847022 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e35c0235-fcb8-47ce-9954-2cda331474fd tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 200 len: 345 microversion: 2.1 time: 0.049025 Feb 21 04:18:08.847588 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 256/527] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:08 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:09.203049 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e0886f30-c3af-427b-b1dc-6f2a974b2a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:09.203662 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e0886f30-c3af-427b-b1dc-6f2a974b2a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:09.210587 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e0886f30-c3af-427b-b1dc-6f2a974b2a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:09.211038 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e0886f30-c3af-427b-b1dc-6f2a974b2a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:09.211816 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e0886f30-c3af-427b-b1dc-6f2a974b2a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:09.212253 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e0886f30-c3af-427b-b1dc-6f2a974b2a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:09.346757 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e0886f30-c3af-427b-b1dc-6f2a974b2a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:09.354961 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e0886f30-c3af-427b-b1dc-6f2a974b2a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:09.356461 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e0886f30-c3af-427b-b1dc-6f2a974b2a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:09.357661 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e0886f30-c3af-427b-b1dc-6f2a974b2a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.158296 Feb 21 04:18:09.358223 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 272/528] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:09 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:09.515562 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-cb06ca28-445b-4ed3-a32d-06ecbef19865 req-ea5a722a-048c-4157-b41e-61fa308cd2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebbdc95-a06a-4deb-91be-ec6dba910154", "name": "network-vif-plugged", "status": "completed", "tag": "913f4d70-2639-4ffc-8df0-8502ed8fa105"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:09.517084 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:18:09.517084 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:18:09.524337 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-cb06ca28-445b-4ed3-a32d-06ecbef19865 req-ea5a722a-048c-4157-b41e-61fa308cd2bc service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:09.524833 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-cb06ca28-445b-4ed3-a32d-06ecbef19865 req-ea5a722a-048c-4157-b41e-61fa308cd2bc service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:09.534984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-cb06ca28-445b-4ed3-a32d-06ecbef19865 req-ea5a722a-048c-4157-b41e-61fa308cd2bc service nova] Creating event network-vif-plugged:913f4d70-2639-4ffc-8df0-8502ed8fa105 for instance 9ebbdc95-a06a-4deb-91be-ec6dba910154 on hv-cinder-77398 Feb 21 04:18:09.539867 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-cb06ca28-445b-4ed3-a32d-06ecbef19865 req-ea5a722a-048c-4157-b41e-61fa308cd2bc service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029180 Feb 21 04:18:09.540452 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 257/529] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:09.570072 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f94ff006-f782-4b18-868d-abaedf8705c9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:09.570686 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f94ff006-f782-4b18-868d-abaedf8705c9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:09.576958 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f94ff006-f782-4b18-868d-abaedf8705c9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:09.577412 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f94ff006-f782-4b18-868d-abaedf8705c9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:09.578188 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f94ff006-f782-4b18-868d-abaedf8705c9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:09.578622 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f94ff006-f782-4b18-868d-abaedf8705c9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:09.707852 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-f94ff006-f782-4b18-868d-abaedf8705c9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:09.714968 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f94ff006-f782-4b18-868d-abaedf8705c9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.148407 Feb 21 04:18:09.715525 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 273/530] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:09 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:09.804256 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f938257d-1348-4cac-b243-3ef404cbeac6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:09.804997 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f938257d-1348-4cac-b243-3ef404cbeac6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:09.811092 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f938257d-1348-4cac-b243-3ef404cbeac6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:09.811537 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f938257d-1348-4cac-b243-3ef404cbeac6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:09.812299 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f938257d-1348-4cac-b243-3ef404cbeac6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:09.812764 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f938257d-1348-4cac-b243-3ef404cbeac6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:09.858911 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-dce47d8f-8f5c-4e6d-82e9-a7e70f1ae457 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0ed9e50>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:09.904314 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-dce47d8f-8f5c-4e6d-82e9-a7e70f1ae457 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 200 len: 345 microversion: 2.1 time: 0.048870 Feb 21 04:18:09.904905 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 274/531] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:09 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:09.948466 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f938257d-1348-4cac-b243-3ef404cbeac6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:09.956282 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f938257d-1348-4cac-b243-3ef404cbeac6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.156054 Feb 21 04:18:09.961973 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 258/532] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:09 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:10.377907 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-195324ea-3936-48e0-8910-821bd8c7647c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:10.378507 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-195324ea-3936-48e0-8910-821bd8c7647c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:10.384294 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-195324ea-3936-48e0-8910-821bd8c7647c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:10.384777 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-195324ea-3936-48e0-8910-821bd8c7647c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:10.385543 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-195324ea-3936-48e0-8910-821bd8c7647c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:10.385972 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-195324ea-3936-48e0-8910-821bd8c7647c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:10.514390 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-195324ea-3936-48e0-8910-821bd8c7647c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:10.522591 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-195324ea-3936-48e0-8910-821bd8c7647c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:10.524068 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-195324ea-3936-48e0-8910-821bd8c7647c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:10.525241 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-195324ea-3936-48e0-8910-821bd8c7647c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.151914 Feb 21 04:18:10.525790 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 275/533] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:10 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:10.731400 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5d68f0a4-cb6a-441b-830e-9f729c1cc35a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:10.733029 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5d68f0a4-cb6a-441b-830e-9f729c1cc35a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:10.742446 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5d68f0a4-cb6a-441b-830e-9f729c1cc35a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:10.745443 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5d68f0a4-cb6a-441b-830e-9f729c1cc35a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:10.746450 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5d68f0a4-cb6a-441b-830e-9f729c1cc35a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:10.746964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5d68f0a4-cb6a-441b-830e-9f729c1cc35a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:10.916064 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6352870a-32e3-4d1d-8d40-f75058ea58a0 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0e969d0>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:10.942605 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5d68f0a4-cb6a-441b-830e-9f729c1cc35a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:10.950409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5d68f0a4-cb6a-441b-830e-9f729c1cc35a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.222865 Feb 21 04:18:10.951311 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 259/534] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:10 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:10.967446 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6352870a-32e3-4d1d-8d40-f75058ea58a0 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 200 len: 345 microversion: 2.1 time: 0.054912 Feb 21 04:18:10.968152 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 276/535] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:10 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:10.973964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d938907b-1815-4ee3-b3a3-a6bb08e549fc tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:10.974570 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d938907b-1815-4ee3-b3a3-a6bb08e549fc tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:10.980474 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d938907b-1815-4ee3-b3a3-a6bb08e549fc tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:10.980958 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d938907b-1815-4ee3-b3a3-a6bb08e549fc tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:10.981887 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d938907b-1815-4ee3-b3a3-a6bb08e549fc tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:10.982325 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d938907b-1815-4ee3-b3a3-a6bb08e549fc tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:11.111479 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d938907b-1815-4ee3-b3a3-a6bb08e549fc tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:11.119054 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d938907b-1815-4ee3-b3a3-a6bb08e549fc tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.148860 Feb 21 04:18:11.119616 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 260/536] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:10 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:11.543504 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7ec30746-1ed7-4872-bec9-c9d85f3f260b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:11.544112 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7ec30746-1ed7-4872-bec9-c9d85f3f260b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:11.550099 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ec30746-1ed7-4872-bec9-c9d85f3f260b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:11.550548 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ec30746-1ed7-4872-bec9-c9d85f3f260b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:11.551324 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ec30746-1ed7-4872-bec9-c9d85f3f260b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:11.551759 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ec30746-1ed7-4872-bec9-c9d85f3f260b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:11.683829 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7ec30746-1ed7-4872-bec9-c9d85f3f260b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:11.691637 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7ec30746-1ed7-4872-bec9-c9d85f3f260b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:11.693228 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7ec30746-1ed7-4872-bec9-c9d85f3f260b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:11.694436 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7ec30746-1ed7-4872-bec9-c9d85f3f260b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.155059 Feb 21 04:18:11.695064 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 277/537] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:11 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:11.967267 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0091b430-cb2a-401f-8972-8de8b03b2a81 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:11.967877 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0091b430-cb2a-401f-8972-8de8b03b2a81 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:11.974531 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0091b430-cb2a-401f-8972-8de8b03b2a81 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:11.974988 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0091b430-cb2a-401f-8972-8de8b03b2a81 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:11.975769 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0091b430-cb2a-401f-8972-8de8b03b2a81 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:11.976263 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0091b430-cb2a-401f-8972-8de8b03b2a81 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:11.980037 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-44c82f7e-27b0-450e-a9c8-502d2dd740aa tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0e4a9d0>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:12.047533 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-44c82f7e-27b0-450e-a9c8-502d2dd740aa tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 200 len: 345 microversion: 2.1 time: 0.071868 Feb 21 04:18:12.048762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 278/538] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:11 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:12.132272 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0091b430-cb2a-401f-8972-8de8b03b2a81 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:12.136151 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b1694982-e01c-46c9-8b6c-162599c5c330 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:12.136811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b1694982-e01c-46c9-8b6c-162599c5c330 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:12.142342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0091b430-cb2a-401f-8972-8de8b03b2a81 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.178768 Feb 21 04:18:12.144325 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 261/539] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:11 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:12.144789 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b1694982-e01c-46c9-8b6c-162599c5c330 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:12.145356 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b1694982-e01c-46c9-8b6c-162599c5c330 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:12.146293 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b1694982-e01c-46c9-8b6c-162599c5c330 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:12.146794 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b1694982-e01c-46c9-8b6c-162599c5c330 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:12.312102 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b1694982-e01c-46c9-8b6c-162599c5c330 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:12.320477 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b1694982-e01c-46c9-8b6c-162599c5c330 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.187924 Feb 21 04:18:12.321315 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 279/540] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:12 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:12.712849 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9217f844-3409-4f4f-b18b-63fbf834fb3b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:12.713459 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9217f844-3409-4f4f-b18b-63fbf834fb3b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:12.719431 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9217f844-3409-4f4f-b18b-63fbf834fb3b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:12.719879 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9217f844-3409-4f4f-b18b-63fbf834fb3b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:12.720674 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9217f844-3409-4f4f-b18b-63fbf834fb3b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:12.721607 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9217f844-3409-4f4f-b18b-63fbf834fb3b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:12.861037 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-7c1f6525-3dda-4293-9ed4-15679b7651f3 req-2cc7ca33-48b4-4c1a-95ae-9710d0314d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f1fe68-8efa-45ce-8c76-671456eca8ec", "name": "network-vif-plugged", "status": "completed", "tag": "d27cb79f-b2f0-42e8-b1b6-081f71fbfcee"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:12.863824 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:18:12.863824 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:18:12.872014 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-7c1f6525-3dda-4293-9ed4-15679b7651f3 req-2cc7ca33-48b4-4c1a-95ae-9710d0314d21 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:12.872613 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-7c1f6525-3dda-4293-9ed4-15679b7651f3 req-2cc7ca33-48b4-4c1a-95ae-9710d0314d21 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:12.885941 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-7c1f6525-3dda-4293-9ed4-15679b7651f3 req-2cc7ca33-48b4-4c1a-95ae-9710d0314d21 service nova] Creating event network-vif-plugged:d27cb79f-b2f0-42e8-b1b6-081f71fbfcee for instance c8f1fe68-8efa-45ce-8c76-671456eca8ec on hv-cinder-77398 Feb 21 04:18:12.891627 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-7c1f6525-3dda-4293-9ed4-15679b7651f3 req-2cc7ca33-48b4-4c1a-95ae-9710d0314d21 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036240 Feb 21 04:18:12.893365 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 280/541] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:12.932292 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9217f844-3409-4f4f-b18b-63fbf834fb3b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:12.940231 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9217f844-3409-4f4f-b18b-63fbf834fb3b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:12.941762 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9217f844-3409-4f4f-b18b-63fbf834fb3b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:12.942922 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9217f844-3409-4f4f-b18b-63fbf834fb3b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.233973 Feb 21 04:18:12.943524 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 262/542] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:12 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:13.060417 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3c3478a4-8f2e-4e13-aaf4-3fcd7cca7639 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0f99700>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:13.105311 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3c3478a4-8f2e-4e13-aaf4-3fcd7cca7639 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 200 len: 346 microversion: 2.1 time: 0.048753 Feb 21 04:18:13.105899 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 281/543] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:13 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:13.116477 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6c62c79f-77c0-4e80-a472-0b51e352e851 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Action: 'create', calling method: .version_select at 0x7feee150c9d0>, body: {"snapshot": {"volume_id": "13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1087359840"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:13.161038 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1dfae759-0cb2-4796-b7aa-d62210f14cda tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:13.161872 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1dfae759-0cb2-4796-b7aa-d62210f14cda tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:13.167826 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1dfae759-0cb2-4796-b7aa-d62210f14cda tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:13.168269 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1dfae759-0cb2-4796-b7aa-d62210f14cda tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:13.169062 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1dfae759-0cb2-4796-b7aa-d62210f14cda tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:13.169501 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1dfae759-0cb2-4796-b7aa-d62210f14cda tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:13.266768 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6c62c79f-77c0-4e80-a472-0b51e352e851 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.153789 Feb 21 04:18:13.268440 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 263/544] 10.222.0.10 () {60 vars in 1161 bytes} [Mon Feb 21 04:18:13 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:13.278757 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-050b55a9-876d-4bb1-b413-e55fbff4b716 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee16328b0>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:13.308889 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-050b55a9-876d-4bb1-b413-e55fbff4b716 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.034877 Feb 21 04:18:13.309455 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 264/545] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:13 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:13.313160 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1dfae759-0cb2-4796-b7aa-d62210f14cda tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:13.318879 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2e8f5c7f-9c7a-4ae3-ab3a-0295045b293e tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee14cc1f0>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:13.320668 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1dfae759-0cb2-4796-b7aa-d62210f14cda tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.163702 Feb 21 04:18:13.321225 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 282/546] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:13 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:13.338452 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f58a8585-df66-4314-96d0-a3eb4265ddc3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:13.339032 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f58a8585-df66-4314-96d0-a3eb4265ddc3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:13.344862 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f58a8585-df66-4314-96d0-a3eb4265ddc3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:13.345311 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f58a8585-df66-4314-96d0-a3eb4265ddc3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:13.346632 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f58a8585-df66-4314-96d0-a3eb4265ddc3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:13.347060 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f58a8585-df66-4314-96d0-a3eb4265ddc3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:13.355188 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2e8f5c7f-9c7a-4ae3-ab3a-0295045b293e tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.039659 Feb 21 04:18:13.355910 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 265/547] 10.222.0.10 () {58 vars in 1139 bytes} [Mon Feb 21 04:18:13 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:13.369304 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fd4e797c-a008-4ec7-ad74-295a03b69494 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee14ccca0>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:13.401624 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fd4e797c-a008-4ec7-ad74-295a03b69494 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.035712 Feb 21 04:18:13.402213 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 266/548] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:13 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:13.522199 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-f58a8585-df66-4314-96d0-a3eb4265ddc3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:13.529691 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f58a8585-df66-4314-96d0-a3eb4265ddc3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.194614 Feb 21 04:18:13.530253 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 283/549] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:13 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:13.961100 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c6680bd1-0d6a-4bfa-bee2-28cf3e195fa7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:13.961707 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c6680bd1-0d6a-4bfa-bee2-28cf3e195fa7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:13.967668 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c6680bd1-0d6a-4bfa-bee2-28cf3e195fa7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:13.968106 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c6680bd1-0d6a-4bfa-bee2-28cf3e195fa7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:13.968926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c6680bd1-0d6a-4bfa-bee2-28cf3e195fa7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:13.969354 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c6680bd1-0d6a-4bfa-bee2-28cf3e195fa7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:14.098146 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c6680bd1-0d6a-4bfa-bee2-28cf3e195fa7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:14.105629 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c6680bd1-0d6a-4bfa-bee2-28cf3e195fa7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:14.107104 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c6680bd1-0d6a-4bfa-bee2-28cf3e195fa7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:14.108225 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c6680bd1-0d6a-4bfa-bee2-28cf3e195fa7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.150794 Feb 21 04:18:14.108831 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 267/550] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:13 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:14.336237 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3cacb10f-7192-4ffa-a86e-3b09f58223fd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:14.336820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3cacb10f-7192-4ffa-a86e-3b09f58223fd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:14.342994 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3cacb10f-7192-4ffa-a86e-3b09f58223fd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:14.343437 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3cacb10f-7192-4ffa-a86e-3b09f58223fd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:14.344198 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3cacb10f-7192-4ffa-a86e-3b09f58223fd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:14.344624 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3cacb10f-7192-4ffa-a86e-3b09f58223fd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:14.413935 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-16e26d82-750a-4bce-99ec-8c9257bae7d9 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee16c35e0>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:14.443287 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-16e26d82-750a-4bce-99ec-8c9257bae7d9 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.032975 Feb 21 04:18:14.443949 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 268/551] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:14 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:14.474877 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-3cacb10f-7192-4ffa-a86e-3b09f58223fd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:14.481979 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3cacb10f-7192-4ffa-a86e-3b09f58223fd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.149460 Feb 21 04:18:14.484460 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 284/552] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:14 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:14.545893 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-83c4fbcf-e2da-430d-a09c-47db96af9b5b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:14.546493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-83c4fbcf-e2da-430d-a09c-47db96af9b5b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:14.552298 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-83c4fbcf-e2da-430d-a09c-47db96af9b5b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:14.552777 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-83c4fbcf-e2da-430d-a09c-47db96af9b5b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:14.553539 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-83c4fbcf-e2da-430d-a09c-47db96af9b5b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:14.553962 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-83c4fbcf-e2da-430d-a09c-47db96af9b5b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:14.904692 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-83c4fbcf-e2da-430d-a09c-47db96af9b5b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:14.911914 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-83c4fbcf-e2da-430d-a09c-47db96af9b5b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.369570 Feb 21 04:18:14.912485 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 269/553] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:14 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:15.126560 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-deb5d6be-8df7-4ac9-abe5-fddd4c595ab1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:15.127591 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-deb5d6be-8df7-4ac9-abe5-fddd4c595ab1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:15.133457 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-deb5d6be-8df7-4ac9-abe5-fddd4c595ab1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:15.133908 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-deb5d6be-8df7-4ac9-abe5-fddd4c595ab1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:15.134688 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-deb5d6be-8df7-4ac9-abe5-fddd4c595ab1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:15.135123 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-deb5d6be-8df7-4ac9-abe5-fddd4c595ab1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:15.278897 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-deb5d6be-8df7-4ac9-abe5-fddd4c595ab1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:15.286513 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-deb5d6be-8df7-4ac9-abe5-fddd4c595ab1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:15.288039 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-deb5d6be-8df7-4ac9-abe5-fddd4c595ab1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:15.289214 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-deb5d6be-8df7-4ac9-abe5-fddd4c595ab1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.166393 Feb 21 04:18:15.289773 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 285/554] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:15 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:15.454085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-56e8cb3c-b590-4cd7-9164-8a9613a88de9 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee1990e50>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:15.481711 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-56e8cb3c-b590-4cd7-9164-8a9613a88de9 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.031138 Feb 21 04:18:15.482262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 270/555] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:15 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:15.498887 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c18ded6b-827b-40f4-b77c-fef93350181b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:15.499489 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c18ded6b-827b-40f4-b77c-fef93350181b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:15.506021 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c18ded6b-827b-40f4-b77c-fef93350181b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:15.506464 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c18ded6b-827b-40f4-b77c-fef93350181b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:15.507237 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c18ded6b-827b-40f4-b77c-fef93350181b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:15.507666 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c18ded6b-827b-40f4-b77c-fef93350181b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:15.655638 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c18ded6b-827b-40f4-b77c-fef93350181b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:15.665040 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c18ded6b-827b-40f4-b77c-fef93350181b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.169744 Feb 21 04:18:15.665625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 286/556] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:15 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:15.933350 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8bc508c8-ee61-46cf-8f8c-d0e4481d2131 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:15.933955 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8bc508c8-ee61-46cf-8f8c-d0e4481d2131 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:15.939931 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8bc508c8-ee61-46cf-8f8c-d0e4481d2131 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:15.940372 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8bc508c8-ee61-46cf-8f8c-d0e4481d2131 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:15.941198 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8bc508c8-ee61-46cf-8f8c-d0e4481d2131 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:15.941629 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8bc508c8-ee61-46cf-8f8c-d0e4481d2131 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:16.068843 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8bc508c8-ee61-46cf-8f8c-d0e4481d2131 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:16.075846 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8bc508c8-ee61-46cf-8f8c-d0e4481d2131 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.146110 Feb 21 04:18:16.076409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 271/557] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:15 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:16.307285 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-00aeb0e2-00c6-4c63-a765-95eae62d7d33 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:16.307927 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-00aeb0e2-00c6-4c63-a765-95eae62d7d33 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:16.313762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-00aeb0e2-00c6-4c63-a765-95eae62d7d33 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:16.314217 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-00aeb0e2-00c6-4c63-a765-95eae62d7d33 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:16.314991 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-00aeb0e2-00c6-4c63-a765-95eae62d7d33 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:16.315427 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-00aeb0e2-00c6-4c63-a765-95eae62d7d33 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:16.447439 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-00aeb0e2-00c6-4c63-a765-95eae62d7d33 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:16.455058 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-00aeb0e2-00c6-4c63-a765-95eae62d7d33 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:16.457258 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-00aeb0e2-00c6-4c63-a765-95eae62d7d33 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:16.458412 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-00aeb0e2-00c6-4c63-a765-95eae62d7d33 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.154767 Feb 21 04:18:16.459267 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 287/558] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:16 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:16.492879 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-58703530-82aa-466e-b7ad-a8c384535a4c tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee15833a0>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:16.521647 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-58703530-82aa-466e-b7ad-a8c384535a4c tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.032243 Feb 21 04:18:16.522207 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 272/559] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:16 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:16.681811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fe6a97da-0e04-4430-93cb-5f365086b839 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:16.682528 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fe6a97da-0e04-4430-93cb-5f365086b839 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:16.688762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fe6a97da-0e04-4430-93cb-5f365086b839 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:16.689214 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fe6a97da-0e04-4430-93cb-5f365086b839 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:16.690485 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fe6a97da-0e04-4430-93cb-5f365086b839 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:16.690920 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fe6a97da-0e04-4430-93cb-5f365086b839 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:16.820498 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-fe6a97da-0e04-4430-93cb-5f365086b839 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:16.827715 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fe6a97da-0e04-4430-93cb-5f365086b839 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.149559 Feb 21 04:18:16.828280 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 288/560] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:16 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:17.092458 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e80f195e-c986-4ef9-8da2-1eda58d8ede8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:17.093010 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e80f195e-c986-4ef9-8da2-1eda58d8ede8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:17.098882 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e80f195e-c986-4ef9-8da2-1eda58d8ede8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:17.099324 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e80f195e-c986-4ef9-8da2-1eda58d8ede8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:17.100092 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e80f195e-c986-4ef9-8da2-1eda58d8ede8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:17.100516 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e80f195e-c986-4ef9-8da2-1eda58d8ede8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:17.300535 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e80f195e-c986-4ef9-8da2-1eda58d8ede8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:17.308388 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e80f195e-c986-4ef9-8da2-1eda58d8ede8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.219586 Feb 21 04:18:17.308981 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 273/561] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:17 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:17.477011 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-25e51524-acdb-4dd8-a8c4-266375dc76f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:17.477616 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-25e51524-acdb-4dd8-a8c4-266375dc76f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:17.483398 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-25e51524-acdb-4dd8-a8c4-266375dc76f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:17.483840 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-25e51524-acdb-4dd8-a8c4-266375dc76f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:17.484602 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-25e51524-acdb-4dd8-a8c4-266375dc76f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:17.485048 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-25e51524-acdb-4dd8-a8c4-266375dc76f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:17.533133 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-95fa9759-2e70-44e8-af5e-946fea8a9a93 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee16c3af0>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:17.564936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-95fa9759-2e70-44e8-af5e-946fea8a9a93 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.035381 Feb 21 04:18:17.565608 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 274/562] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:17 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:17.680545 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-25e51524-acdb-4dd8-a8c4-266375dc76f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:17.688589 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-25e51524-acdb-4dd8-a8c4-266375dc76f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:17.690091 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-25e51524-acdb-4dd8-a8c4-266375dc76f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:17.691225 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-25e51524-acdb-4dd8-a8c4-266375dc76f7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.217869 Feb 21 04:18:17.691781 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 289/563] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:17 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:17.844201 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-dee13ef0-b2f4-4daa-894c-62592e09492d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:17.844839 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-dee13ef0-b2f4-4daa-894c-62592e09492d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:17.851324 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dee13ef0-b2f4-4daa-894c-62592e09492d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:17.851764 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dee13ef0-b2f4-4daa-894c-62592e09492d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:17.852527 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dee13ef0-b2f4-4daa-894c-62592e09492d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:17.852993 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dee13ef0-b2f4-4daa-894c-62592e09492d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:17.987822 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-dee13ef0-b2f4-4daa-894c-62592e09492d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:17.996036 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-dee13ef0-b2f4-4daa-894c-62592e09492d tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.155403 Feb 21 04:18:17.996599 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 275/564] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:17 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:18.324883 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b71be665-0cd6-48f8-a667-6de633a2b90f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:18.325502 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b71be665-0cd6-48f8-a667-6de633a2b90f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:18.331359 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b71be665-0cd6-48f8-a667-6de633a2b90f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:18.331815 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b71be665-0cd6-48f8-a667-6de633a2b90f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:18.332595 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b71be665-0cd6-48f8-a667-6de633a2b90f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:18.333055 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b71be665-0cd6-48f8-a667-6de633a2b90f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:18.475724 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b71be665-0cd6-48f8-a667-6de633a2b90f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:18.483732 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b71be665-0cd6-48f8-a667-6de633a2b90f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1314 microversion: 2.1 time: 0.162405 Feb 21 04:18:18.484279 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 290/565] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:18 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:18.576072 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-26a36209-2894-4125-a4ee-f1111becdf62 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee14ccb80>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:18.604223 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-26a36209-2894-4125-a4ee-f1111becdf62 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.031842 Feb 21 04:18:18.604829 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 276/566] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:18 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:18.708877 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-2e26448b-1d02-4749-b35f-3ce0fd46ca2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:18.709506 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-2e26448b-1d02-4749-b35f-3ce0fd46ca2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:18.715610 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2e26448b-1d02-4749-b35f-3ce0fd46ca2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:18.716057 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2e26448b-1d02-4749-b35f-3ce0fd46ca2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:18.716847 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2e26448b-1d02-4749-b35f-3ce0fd46ca2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:18.717272 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2e26448b-1d02-4749-b35f-3ce0fd46ca2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:18.849437 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-2e26448b-1d02-4749-b35f-3ce0fd46ca2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:18.857037 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-2e26448b-1d02-4749-b35f-3ce0fd46ca2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:18.858519 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-2e26448b-1d02-4749-b35f-3ce0fd46ca2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:18.859653 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-2e26448b-1d02-4749-b35f-3ce0fd46ca2a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.154446 Feb 21 04:18:18.860207 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 291/567] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:18 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:19.012657 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1994f32c-4f12-41f2-8fe9-8ddf0e48245a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:19.013260 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1994f32c-4f12-41f2-8fe9-8ddf0e48245a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:19.019519 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1994f32c-4f12-41f2-8fe9-8ddf0e48245a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:19.019956 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1994f32c-4f12-41f2-8fe9-8ddf0e48245a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:19.020741 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1994f32c-4f12-41f2-8fe9-8ddf0e48245a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:19.021168 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1994f32c-4f12-41f2-8fe9-8ddf0e48245a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:19.150211 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1994f32c-4f12-41f2-8fe9-8ddf0e48245a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:19.157453 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1994f32c-4f12-41f2-8fe9-8ddf0e48245a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.148414 Feb 21 04:18:19.158011 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 277/568] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:19 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:19.500707 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0a758723-5e1b-4daf-b3d3-a5d5bff9cc90 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:19.501314 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0a758723-5e1b-4daf-b3d3-a5d5bff9cc90 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:19.507646 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0a758723-5e1b-4daf-b3d3-a5d5bff9cc90 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:19.508098 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0a758723-5e1b-4daf-b3d3-a5d5bff9cc90 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:19.508891 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0a758723-5e1b-4daf-b3d3-a5d5bff9cc90 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:19.509323 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0a758723-5e1b-4daf-b3d3-a5d5bff9cc90 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:19.615085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-da6401dc-c668-4f22-a55d-6ef15a4203c5 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee14e5790>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:19.641887 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0a758723-5e1b-4daf-b3d3-a5d5bff9cc90 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:19.644733 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-da6401dc-c668-4f22-a55d-6ef15a4203c5 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.033122 Feb 21 04:18:19.645310 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 278/569] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:19 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:19.650028 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0a758723-5e1b-4daf-b3d3-a5d5bff9cc90 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1499 microversion: 2.1 time: 0.152966 Feb 21 04:18:19.650580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 292/570] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:19 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1499 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:19.878633 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5dba91bf-1257-4d44-aebe-bef0804aff27 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:19.879239 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5dba91bf-1257-4d44-aebe-bef0804aff27 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:19.885090 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5dba91bf-1257-4d44-aebe-bef0804aff27 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:19.885543 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5dba91bf-1257-4d44-aebe-bef0804aff27 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:19.886316 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5dba91bf-1257-4d44-aebe-bef0804aff27 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:19.886751 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5dba91bf-1257-4d44-aebe-bef0804aff27 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:20.019057 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5dba91bf-1257-4d44-aebe-bef0804aff27 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:20.026555 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5dba91bf-1257-4d44-aebe-bef0804aff27 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:20.028296 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5dba91bf-1257-4d44-aebe-bef0804aff27 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:20.029456 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5dba91bf-1257-4d44-aebe-bef0804aff27 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.155097 Feb 21 04:18:20.030012 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 279/571] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:19 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:20.174791 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1f6fe4bc-364c-4d36-8fab-6c7df85f43ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:20.175392 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1f6fe4bc-364c-4d36-8fab-6c7df85f43ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:20.181568 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1f6fe4bc-364c-4d36-8fab-6c7df85f43ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:20.182011 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1f6fe4bc-364c-4d36-8fab-6c7df85f43ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:20.182771 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1f6fe4bc-364c-4d36-8fab-6c7df85f43ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:20.183196 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1f6fe4bc-364c-4d36-8fab-6c7df85f43ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:20.313601 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1f6fe4bc-364c-4d36-8fab-6c7df85f43ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:20.320847 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1f6fe4bc-364c-4d36-8fab-6c7df85f43ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.150230 Feb 21 04:18:20.321421 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 293/572] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:20 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:20.656184 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-529dc215-598d-4fac-a269-56e2fdffb35e tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee14e5f70>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:20.685081 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-529dc215-598d-4fac-a269-56e2fdffb35e tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.032631 Feb 21 04:18:20.685654 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 280/573] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:20 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:21.046994 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9a2b6a93-a8e0-45fe-aa83-de329dac5c71 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:21.047596 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9a2b6a93-a8e0-45fe-aa83-de329dac5c71 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:21.053336 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9a2b6a93-a8e0-45fe-aa83-de329dac5c71 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:21.053776 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9a2b6a93-a8e0-45fe-aa83-de329dac5c71 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:21.054542 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9a2b6a93-a8e0-45fe-aa83-de329dac5c71 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:21.054967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9a2b6a93-a8e0-45fe-aa83-de329dac5c71 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:21.186352 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9a2b6a93-a8e0-45fe-aa83-de329dac5c71 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:21.194450 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9a2b6a93-a8e0-45fe-aa83-de329dac5c71 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:21.195923 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9a2b6a93-a8e0-45fe-aa83-de329dac5c71 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:21.197086 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9a2b6a93-a8e0-45fe-aa83-de329dac5c71 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.153705 Feb 21 04:18:21.197666 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 294/574] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:21 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:21.337449 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fe817a47-ee31-4bd1-82dc-02ee8c6cb356 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:21.337992 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fe817a47-ee31-4bd1-82dc-02ee8c6cb356 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:21.343914 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fe817a47-ee31-4bd1-82dc-02ee8c6cb356 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:21.344361 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fe817a47-ee31-4bd1-82dc-02ee8c6cb356 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:21.345159 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fe817a47-ee31-4bd1-82dc-02ee8c6cb356 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:21.345597 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fe817a47-ee31-4bd1-82dc-02ee8c6cb356 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:21.475564 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fe817a47-ee31-4bd1-82dc-02ee8c6cb356 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:21.482689 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fe817a47-ee31-4bd1-82dc-02ee8c6cb356 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.148991 Feb 21 04:18:21.483242 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 281/575] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:21 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:21.696869 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7b80aee1-9a81-4977-8adc-23b1b2879d62 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0d7f670>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:21.725936 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7b80aee1-9a81-4977-8adc-23b1b2879d62 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.032653 Feb 21 04:18:21.726742 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 295/576] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:21 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:22.215569 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-03ca6c2f-6be0-4240-a2e5-5c1527f99c3e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:22.216169 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-03ca6c2f-6be0-4240-a2e5-5c1527f99c3e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:22.222376 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03ca6c2f-6be0-4240-a2e5-5c1527f99c3e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:22.222813 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03ca6c2f-6be0-4240-a2e5-5c1527f99c3e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:22.223572 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03ca6c2f-6be0-4240-a2e5-5c1527f99c3e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:22.224028 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03ca6c2f-6be0-4240-a2e5-5c1527f99c3e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:22.354945 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-03ca6c2f-6be0-4240-a2e5-5c1527f99c3e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:22.363156 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-03ca6c2f-6be0-4240-a2e5-5c1527f99c3e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:22.364668 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-03ca6c2f-6be0-4240-a2e5-5c1527f99c3e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:22.365793 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-03ca6c2f-6be0-4240-a2e5-5c1527f99c3e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.153985 Feb 21 04:18:22.366342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 282/577] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:22 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:22.499955 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b66c4293-5734-4f82-8bc4-47af25044aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:22.500477 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b66c4293-5734-4f82-8bc4-47af25044aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:22.506343 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b66c4293-5734-4f82-8bc4-47af25044aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:22.506791 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b66c4293-5734-4f82-8bc4-47af25044aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:22.507560 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b66c4293-5734-4f82-8bc4-47af25044aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:22.507992 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b66c4293-5734-4f82-8bc4-47af25044aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:22.646464 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b66c4293-5734-4f82-8bc4-47af25044aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:22.653990 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b66c4293-5734-4f82-8bc4-47af25044aa7 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.158155 Feb 21 04:18:22.654551 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 296/578] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:22 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:22.736813 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-00dedc84-795d-4007-a1bf-2ca7dbaf5a05 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee14cc790>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:22.764411 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-00dedc84-795d-4007-a1bf-2ca7dbaf5a05 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.031048 Feb 21 04:18:22.765011 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 283/579] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:22 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:23.383555 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9ab8f644-995a-433f-bd6c-de66287ec6f1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:23.384179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9ab8f644-995a-433f-bd6c-de66287ec6f1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:23.390012 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9ab8f644-995a-433f-bd6c-de66287ec6f1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:23.390456 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9ab8f644-995a-433f-bd6c-de66287ec6f1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:23.391224 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9ab8f644-995a-433f-bd6c-de66287ec6f1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:23.391654 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9ab8f644-995a-433f-bd6c-de66287ec6f1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:23.521785 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9ab8f644-995a-433f-bd6c-de66287ec6f1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:23.529596 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9ab8f644-995a-433f-bd6c-de66287ec6f1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:23.531082 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9ab8f644-995a-433f-bd6c-de66287ec6f1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:23.532217 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9ab8f644-995a-433f-bd6c-de66287ec6f1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.152393 Feb 21 04:18:23.532796 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 297/580] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:23 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:23.671144 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b922278e-bf0a-463c-a0e1-805c3de38339 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:23.671755 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b922278e-bf0a-463c-a0e1-805c3de38339 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:23.678135 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b922278e-bf0a-463c-a0e1-805c3de38339 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:23.678580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b922278e-bf0a-463c-a0e1-805c3de38339 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:23.679352 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b922278e-bf0a-463c-a0e1-805c3de38339 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:23.679781 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b922278e-bf0a-463c-a0e1-805c3de38339 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:23.774793 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d6874a1e-a2f6-47ad-8cc3-45e26b2588bf tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0d7fee0>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:23.802824 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d6874a1e-a2f6-47ad-8cc3-45e26b2588bf tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.031467 Feb 21 04:18:23.803430 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 298/581] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:23 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:23.814579 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b922278e-bf0a-463c-a0e1-805c3de38339 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:23.822308 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b922278e-bf0a-463c-a0e1-805c3de38339 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1317 microversion: 2.1 time: 0.155180 Feb 21 04:18:23.822856 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 284/582] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:23 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:24.550902 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6a86be5f-78ec-4453-a16a-5ad409e51bee tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:24.551534 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6a86be5f-78ec-4453-a16a-5ad409e51bee tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:24.557296 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6a86be5f-78ec-4453-a16a-5ad409e51bee tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:24.557738 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6a86be5f-78ec-4453-a16a-5ad409e51bee tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:24.558507 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6a86be5f-78ec-4453-a16a-5ad409e51bee tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:24.558937 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6a86be5f-78ec-4453-a16a-5ad409e51bee tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:24.689064 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6a86be5f-78ec-4453-a16a-5ad409e51bee tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:24.697195 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6a86be5f-78ec-4453-a16a-5ad409e51bee tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:24.698678 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6a86be5f-78ec-4453-a16a-5ad409e51bee tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:24.699819 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6a86be5f-78ec-4453-a16a-5ad409e51bee tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.153341 Feb 21 04:18:24.700376 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 299/583] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:24 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:24.814165 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5bf27c8f-ff61-43c7-baa5-2d153abf6297 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee14cc160>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:24.839169 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-961ee6c7-4850-44c9-b0c2-3dcb0c9995e5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:24.839787 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-961ee6c7-4850-44c9-b0c2-3dcb0c9995e5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:24.844262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5bf27c8f-ff61-43c7-baa5-2d153abf6297 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 288 microversion: 2.1 time: 0.033606 Feb 21 04:18:24.844897 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 285/584] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:24 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:24.846281 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-961ee6c7-4850-44c9-b0c2-3dcb0c9995e5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:24.846739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-961ee6c7-4850-44c9-b0c2-3dcb0c9995e5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:24.847528 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-961ee6c7-4850-44c9-b0c2-3dcb0c9995e5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:24.847956 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-961ee6c7-4850-44c9-b0c2-3dcb0c9995e5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:24.854455 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b26e875c-0654-4d76-b0e5-7aa1b4e76f7f tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee14c69d0>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:24.909238 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b26e875c-0654-4d76-b0e5-7aa1b4e76f7f tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "DELETE /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 202 len: 0 microversion: 2.1 time: 0.058166 Feb 21 04:18:24.909811 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 286/585] 10.222.0.10 () {58 vars in 1253 bytes} [Mon Feb 21 04:18:24 2022] DELETE /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 04:18:24.919190 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6b94335b-5b64-409a-9b15-f258bcba164f tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee147d670>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:24.978783 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6b94335b-5b64-409a-9b15-f258bcba164f tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.063692 Feb 21 04:18:24.979480 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 287/586] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:24 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:24.989649 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-961ee6c7-4850-44c9-b0c2-3dcb0c9995e5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:24.996805 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-961ee6c7-4850-44c9-b0c2-3dcb0c9995e5 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1507 microversion: 2.1 time: 0.161721 Feb 21 04:18:24.997363 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 300/587] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:24 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:25.719261 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-35fcb3bb-1a8d-46cb-b625-27bf3ac0e753 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:25.719860 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-35fcb3bb-1a8d-46cb-b625-27bf3ac0e753 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:25.726270 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35fcb3bb-1a8d-46cb-b625-27bf3ac0e753 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:25.726711 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35fcb3bb-1a8d-46cb-b625-27bf3ac0e753 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:25.727467 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35fcb3bb-1a8d-46cb-b625-27bf3ac0e753 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:25.727894 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35fcb3bb-1a8d-46cb-b625-27bf3ac0e753 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:25.858540 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-35fcb3bb-1a8d-46cb-b625-27bf3ac0e753 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:25.866070 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-35fcb3bb-1a8d-46cb-b625-27bf3ac0e753 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:25.867549 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-35fcb3bb-1a8d-46cb-b625-27bf3ac0e753 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:25.868700 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-35fcb3bb-1a8d-46cb-b625-27bf3ac0e753 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.153125 Feb 21 04:18:25.869252 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 288/588] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:25 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:25.989931 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-bd7ae940-a77a-408c-9c84-7487ce712518 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0deaee0>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:26.017163 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-bd7ae940-a77a-408c-9c84-7487ce712518 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.030908 Feb 21 04:18:26.017736 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 301/589] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:25 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:26.886298 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6c6ce839-57a8-44c3-95a1-2e1bf1a60f0c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:26.886904 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6c6ce839-57a8-44c3-95a1-2e1bf1a60f0c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:26.893242 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6c6ce839-57a8-44c3-95a1-2e1bf1a60f0c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:26.893691 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6c6ce839-57a8-44c3-95a1-2e1bf1a60f0c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:26.894463 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6c6ce839-57a8-44c3-95a1-2e1bf1a60f0c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:26.894900 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6c6ce839-57a8-44c3-95a1-2e1bf1a60f0c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:27.026510 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6c6ce839-57a8-44c3-95a1-2e1bf1a60f0c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:27.029727 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4636331f-66fe-429c-9955-339adb131854 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0e0ff70>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:27.035021 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6c6ce839-57a8-44c3-95a1-2e1bf1a60f0c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:27.036532 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6c6ce839-57a8-44c3-95a1-2e1bf1a60f0c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:27.037952 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6c6ce839-57a8-44c3-95a1-2e1bf1a60f0c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.155354 Feb 21 04:18:27.038495 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 289/590] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:26 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:27.057993 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4636331f-66fe-429c-9955-339adb131854 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.032470 Feb 21 04:18:27.058547 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 302/591] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:27 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:28.056014 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7616d952-e48e-4867-973b-750a89fd357a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:28.056567 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7616d952-e48e-4867-973b-750a89fd357a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:28.063125 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7616d952-e48e-4867-973b-750a89fd357a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:28.063572 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7616d952-e48e-4867-973b-750a89fd357a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:28.064348 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7616d952-e48e-4867-973b-750a89fd357a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:28.064812 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7616d952-e48e-4867-973b-750a89fd357a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:28.068782 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-889c6bdb-190c-47a2-a94c-c1090a2ca3b7 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0d92700>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:28.097019 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-889c6bdb-190c-47a2-a94c-c1090a2ca3b7 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.032147 Feb 21 04:18:28.097588 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 303/592] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:28 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:28.199066 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7616d952-e48e-4867-973b-750a89fd357a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:28.206944 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7616d952-e48e-4867-973b-750a89fd357a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:28.208444 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7616d952-e48e-4867-973b-750a89fd357a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:28.209628 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7616d952-e48e-4867-973b-750a89fd357a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.157372 Feb 21 04:18:28.210187 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 290/593] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:28 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:29.108665 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0cc9bc32-a283-4a0a-91cb-f65dab7511f6 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0e0f820>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:29.136841 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0cc9bc32-a283-4a0a-91cb-f65dab7511f6 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.032242 Feb 21 04:18:29.137400 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 304/594] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:29 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:29.227030 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8b19c471-a384-4add-b1ba-2c8594402b62 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:29.227667 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8b19c471-a384-4add-b1ba-2c8594402b62 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:29.233844 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8b19c471-a384-4add-b1ba-2c8594402b62 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:29.234290 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8b19c471-a384-4add-b1ba-2c8594402b62 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:29.235058 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8b19c471-a384-4add-b1ba-2c8594402b62 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:29.235490 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8b19c471-a384-4add-b1ba-2c8594402b62 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:29.372785 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8b19c471-a384-4add-b1ba-2c8594402b62 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:29.380798 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8b19c471-a384-4add-b1ba-2c8594402b62 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:29.382290 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8b19c471-a384-4add-b1ba-2c8594402b62 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:29.383424 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8b19c471-a384-4add-b1ba-2c8594402b62 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.160019 Feb 21 04:18:29.383977 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 291/595] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:29 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:30.148580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5040dcb4-efc9-4689-8fa0-82aa4d1d8dc2 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0de6e50>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:30.178851 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5040dcb4-efc9-4689-8fa0-82aa4d1d8dc2 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 200 len: 287 microversion: 2.1 time: 0.034311 Feb 21 04:18:30.179521 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 305/596] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:30 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:30.286375 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8a6e8b56-d403-44d0-8a5c-f0f797e21148 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:30.286904 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8a6e8b56-d403-44d0-8a5c-f0f797e21148 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:30.292990 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8a6e8b56-d403-44d0-8a5c-f0f797e21148 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:30.293430 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8a6e8b56-d403-44d0-8a5c-f0f797e21148 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:30.294204 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8a6e8b56-d403-44d0-8a5c-f0f797e21148 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:30.294689 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8a6e8b56-d403-44d0-8a5c-f0f797e21148 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:30.318383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8a6e8b56-d403-44d0-8a5c-f0f797e21148 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Going to try to terminate instance {{(pid=116570) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:18:30.396653 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8a6e8b56-d403-44d0-8a5c-f0f797e21148 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "DELETE /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 204 len: 0 microversion: 2.1 time: 0.114146 Feb 21 04:18:30.397783 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 292/597] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:18:30 2022] DELETE /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:18:30.402788 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4718d04a-b720-4fcb-a2aa-6c6d3ad98838 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:30.403663 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4718d04a-b720-4fcb-a2aa-6c6d3ad98838 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:30.405929 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-74a610ee-4568-416b-b11d-2ba9d5c9d420 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:30.407287 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-74a610ee-4568-416b-b11d-2ba9d5c9d420 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:30.410898 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4718d04a-b720-4fcb-a2aa-6c6d3ad98838 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:30.411354 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4718d04a-b720-4fcb-a2aa-6c6d3ad98838 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:30.412139 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4718d04a-b720-4fcb-a2aa-6c6d3ad98838 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:30.412597 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4718d04a-b720-4fcb-a2aa-6c6d3ad98838 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:30.413592 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-74a610ee-4568-416b-b11d-2ba9d5c9d420 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:30.414035 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-74a610ee-4568-416b-b11d-2ba9d5c9d420 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:30.414861 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-74a610ee-4568-416b-b11d-2ba9d5c9d420 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:30.415225 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-74a610ee-4568-416b-b11d-2ba9d5c9d420 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:30.608374 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-74a610ee-4568-416b-b11d-2ba9d5c9d420 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:30.611488 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4718d04a-b720-4fcb-a2aa-6c6d3ad98838 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:30.615862 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-74a610ee-4568-416b-b11d-2ba9d5c9d420 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1505 microversion: 2.1 time: 0.213930 Feb 21 04:18:30.616572 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 293/598] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:30 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:30.619997 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4718d04a-b720-4fcb-a2aa-6c6d3ad98838 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:30.621559 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4718d04a-b720-4fcb-a2aa-6c6d3ad98838 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:30.622710 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4718d04a-b720-4fcb-a2aa-6c6d3ad98838 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.224283 Feb 21 04:18:30.623569 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 306/599] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:30 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:18:31.190209 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-171866a3-e04c-4cb1-b0a6-359573d78a34 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee16c3670>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:31.214985 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-171866a3-e04c-4cb1-b0a6-359573d78a34 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] HTTP exception thrown: Snapshot 9e12eded-4782-4bc7-9ec9-8cb6b2f30727 could not be found. Feb 21 04:18:31.215575 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-171866a3-e04c-4cb1-b0a6-359573d78a34 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Returning 404 to user: Snapshot 9e12eded-4782-4bc7-9ec9-8cb6b2f30727 could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:31.216459 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-171866a3-e04c-4cb1-b0a6-359573d78a34 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727" status: 404 len: 111 microversion: 2.1 time: 0.029897 Feb 21 04:18:31.216955 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 294/600] 10.222.0.10 () {58 vars in 1250 bytes} [Mon Feb 21 04:18:31 2022] GET /compute/v2.1/os-snapshots/9e12eded-4782-4bc7-9ec9-8cb6b2f30727 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:18:31.229627 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f375332d-d549-4961-94d1-09b907b2818b tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0d924c0>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:31.290286 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f375332d-d549-4961-94d1-09b907b2818b tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "DELETE /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 202 len: 0 microversion: 2.1 time: 0.064641 Feb 21 04:18:31.290848 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 307/601] 10.222.0.10 () {58 vars in 1247 bytes} [Mon Feb 21 04:18:31 2022] DELETE /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 04:18:31.300133 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-45b2d6cd-a019-42ee-bd84-80caa6c4d5d5 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee14a69d0>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:31.349234 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-45b2d6cd-a019-42ee-bd84-80caa6c4d5d5 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 200 len: 345 microversion: 2.1 time: 0.053811 Feb 21 04:18:31.349795 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 295/602] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:31 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:31.633473 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a76748e4-8142-4f4a-8f36-52452a48aa04 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:31.634106 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a76748e4-8142-4f4a-8f36-52452a48aa04 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:31.641329 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8d96329f-93b4-4bcd-ab1d-54c6dc1afb30 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:31.641455 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a76748e4-8142-4f4a-8f36-52452a48aa04 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:31.641940 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8d96329f-93b4-4bcd-ab1d-54c6dc1afb30 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:31.642038 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a76748e4-8142-4f4a-8f36-52452a48aa04 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:31.642757 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a76748e4-8142-4f4a-8f36-52452a48aa04 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:31.643187 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a76748e4-8142-4f4a-8f36-52452a48aa04 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:31.648672 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8d96329f-93b4-4bcd-ab1d-54c6dc1afb30 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:31.648672 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8d96329f-93b4-4bcd-ab1d-54c6dc1afb30 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:31.649384 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8d96329f-93b4-4bcd-ab1d-54c6dc1afb30 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:31.649821 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8d96329f-93b4-4bcd-ab1d-54c6dc1afb30 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:31.851726 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a76748e4-8142-4f4a-8f36-52452a48aa04 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:31.856142 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8d96329f-93b4-4bcd-ab1d-54c6dc1afb30 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:31.859418 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a76748e4-8142-4f4a-8f36-52452a48aa04 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1505 microversion: 2.1 time: 0.229811 Feb 21 04:18:31.860188 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 308/603] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:31 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:31.864655 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-27a8cb1e-2281-4200-8f50-f08dc481d16e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c2facd8-9e5d-40a8-97dd-bc565d1e7515"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:31.865760 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-27a8cb1e-2281-4200-8f50-f08dc481d16e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:31.865958 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8d96329f-93b4-4bcd-ab1d-54c6dc1afb30 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:31.867561 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8d96329f-93b4-4bcd-ab1d-54c6dc1afb30 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:31.868818 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8d96329f-93b4-4bcd-ab1d-54c6dc1afb30 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.231467 Feb 21 04:18:31.869444 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 296/604] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:31 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:18:31.871442 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-27a8cb1e-2281-4200-8f50-f08dc481d16e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:31.871887 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-27a8cb1e-2281-4200-8f50-f08dc481d16e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:31.872673 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-27a8cb1e-2281-4200-8f50-f08dc481d16e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:31.873104 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-27a8cb1e-2281-4200-8f50-f08dc481d16e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:32.361907 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e92759e1-3ad7-4d02-9202-4adaf6c746c7 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee14ccd30>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:32.406495 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e92759e1-3ad7-4d02-9202-4adaf6c746c7 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 200 len: 345 microversion: 2.1 time: 0.048199 Feb 21 04:18:32.407076 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 297/605] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:32 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 345 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:32.875861 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5023798a-a698-44fd-b398-976940ad9240 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:32.876484 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5023798a-a698-44fd-b398-976940ad9240 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:32.882440 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5023798a-a698-44fd-b398-976940ad9240 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:32.882877 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5023798a-a698-44fd-b398-976940ad9240 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:32.883632 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5023798a-a698-44fd-b398-976940ad9240 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:32.884063 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5023798a-a698-44fd-b398-976940ad9240 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:33.017392 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5023798a-a698-44fd-b398-976940ad9240 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:33.024904 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5023798a-a698-44fd-b398-976940ad9240 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1505 microversion: 2.1 time: 0.152542 Feb 21 04:18:33.025505 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 298/606] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:32 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:33.030031 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6e918459-89ce-4dd9-b1c5-2a3a744ee58f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:33.030629 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6e918459-89ce-4dd9-b1c5-2a3a744ee58f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:33.036770 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6e918459-89ce-4dd9-b1c5-2a3a744ee58f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:33.037221 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6e918459-89ce-4dd9-b1c5-2a3a744ee58f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:33.037994 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6e918459-89ce-4dd9-b1c5-2a3a744ee58f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:33.038424 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6e918459-89ce-4dd9-b1c5-2a3a744ee58f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:33.175537 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6e918459-89ce-4dd9-b1c5-2a3a744ee58f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:33.183227 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6e918459-89ce-4dd9-b1c5-2a3a744ee58f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:33.184862 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6e918459-89ce-4dd9-b1c5-2a3a744ee58f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:33.185997 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6e918459-89ce-4dd9-b1c5-2a3a744ee58f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.159591 Feb 21 04:18:33.186574 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 299/607] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:33 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:33.418413 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d5aae418-1cc4-4315-902f-32195317869c tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee1632a60>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:33.461888 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d5aae418-1cc4-4315-902f-32195317869c tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 200 len: 345 microversion: 2.1 time: 0.047001 Feb 21 04:18:33.462442 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 300/608] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:33 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 345 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:34.042664 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-98280379-f219-4de4-aa97-cdbd5e3e49b8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:34.043282 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-98280379-f219-4de4-aa97-cdbd5e3e49b8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:34.050109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-98280379-f219-4de4-aa97-cdbd5e3e49b8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:34.050595 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-98280379-f219-4de4-aa97-cdbd5e3e49b8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:34.051411 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-98280379-f219-4de4-aa97-cdbd5e3e49b8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:34.051837 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-98280379-f219-4de4-aa97-cdbd5e3e49b8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:34.161579 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-27a8cb1e-2281-4200-8f50-f08dc481d16e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "POST /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.299985 Feb 21 04:18:34.162443 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 309/609] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:18:31 2022] POST /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec/os-volume_attachments => generated 194 bytes in 2302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:34.189609 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-98280379-f219-4de4-aa97-cdbd5e3e49b8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:34.198668 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-98280379-f219-4de4-aa97-cdbd5e3e49b8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1505 microversion: 2.1 time: 0.159586 Feb 21 04:18:34.199251 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 301/610] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:34 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:34.204230 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e04a26cf-2c0d-4458-bc84-20d4770d6c4f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:34.205438 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e04a26cf-2c0d-4458-bc84-20d4770d6c4f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:34.212870 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e04a26cf-2c0d-4458-bc84-20d4770d6c4f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:34.212870 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e04a26cf-2c0d-4458-bc84-20d4770d6c4f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:34.213364 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e04a26cf-2c0d-4458-bc84-20d4770d6c4f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:34.214161 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e04a26cf-2c0d-4458-bc84-20d4770d6c4f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:34.353431 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e04a26cf-2c0d-4458-bc84-20d4770d6c4f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:34.361349 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e04a26cf-2c0d-4458-bc84-20d4770d6c4f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:34.363482 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e04a26cf-2c0d-4458-bc84-20d4770d6c4f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:34.364676 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e04a26cf-2c0d-4458-bc84-20d4770d6c4f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1746 microversion: 2.20 time: 0.165130 Feb 21 04:18:34.365231 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 310/611] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:34 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:18:34.474409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7accad0a-e049-4b34-8ce3-380528e64ce7 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee14cc0d0>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:34.519728 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7accad0a-e049-4b34-8ce3-380528e64ce7 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 200 len: 345 microversion: 2.1 time: 0.049372 Feb 21 04:18:34.520272 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 302/612] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:34 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:35.218731 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c539db1d-d761-466c-b0ba-26acb9be7fb6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:35.219366 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c539db1d-d761-466c-b0ba-26acb9be7fb6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:35.225692 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c539db1d-d761-466c-b0ba-26acb9be7fb6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:35.226132 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c539db1d-d761-466c-b0ba-26acb9be7fb6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:35.226901 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c539db1d-d761-466c-b0ba-26acb9be7fb6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:35.227326 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c539db1d-d761-466c-b0ba-26acb9be7fb6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:35.356968 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c539db1d-d761-466c-b0ba-26acb9be7fb6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:35.364056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c539db1d-d761-466c-b0ba-26acb9be7fb6 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1505 microversion: 2.1 time: 0.148903 Feb 21 04:18:35.364613 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 311/613] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:35 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:35.383192 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9c64a6d4-1efe-45d8-8237-110cd2b5d1ca tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:35.383793 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9c64a6d4-1efe-45d8-8237-110cd2b5d1ca tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:35.389606 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9c64a6d4-1efe-45d8-8237-110cd2b5d1ca tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:35.390048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9c64a6d4-1efe-45d8-8237-110cd2b5d1ca tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:35.390809 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9c64a6d4-1efe-45d8-8237-110cd2b5d1ca tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:35.391237 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9c64a6d4-1efe-45d8-8237-110cd2b5d1ca tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:35.527473 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9c64a6d4-1efe-45d8-8237-110cd2b5d1ca tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:35.531970 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-41bc257e-439a-44a9-bcaf-bdb656bd3983 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0ee5b80>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:35.540065 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9c64a6d4-1efe-45d8-8237-110cd2b5d1ca tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:35.541634 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9c64a6d4-1efe-45d8-8237-110cd2b5d1ca tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:35.542790 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9c64a6d4-1efe-45d8-8237-110cd2b5d1ca tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1746 microversion: 2.20 time: 0.163301 Feb 21 04:18:35.543466 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 303/614] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:35 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:35.586193 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-41bc257e-439a-44a9-bcaf-bdb656bd3983 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 200 len: 345 microversion: 2.1 time: 0.058065 Feb 21 04:18:35.586898 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 312/615] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:35 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:36.380416 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5c4e8f06-bcab-4c51-8874-072e8a98aa4f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:36.381041 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5c4e8f06-bcab-4c51-8874-072e8a98aa4f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:36.386780 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c4e8f06-bcab-4c51-8874-072e8a98aa4f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:36.387221 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c4e8f06-bcab-4c51-8874-072e8a98aa4f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:36.387978 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c4e8f06-bcab-4c51-8874-072e8a98aa4f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:36.388402 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c4e8f06-bcab-4c51-8874-072e8a98aa4f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:36.515598 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5c4e8f06-bcab-4c51-8874-072e8a98aa4f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:36.523414 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5c4e8f06-bcab-4c51-8874-072e8a98aa4f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1505 microversion: 2.1 time: 0.146437 Feb 21 04:18:36.523906 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 304/616] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:36 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:36.561476 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-970c0976-aa9a-49bf-997c-0f17fc226efb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:36.562147 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-970c0976-aa9a-49bf-997c-0f17fc226efb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:36.568412 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-970c0976-aa9a-49bf-997c-0f17fc226efb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:36.568881 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-970c0976-aa9a-49bf-997c-0f17fc226efb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:36.569649 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-970c0976-aa9a-49bf-997c-0f17fc226efb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:36.570075 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-970c0976-aa9a-49bf-997c-0f17fc226efb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:36.598282 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ffa29ff0-ab7c-4e57-a293-5e481c230aba tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee14a6e50>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:36.644343 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ffa29ff0-ab7c-4e57-a293-5e481c230aba tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 200 len: 345 microversion: 2.1 time: 0.049500 Feb 21 04:18:36.644956 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 305/617] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:36 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:36.700381 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-970c0976-aa9a-49bf-997c-0f17fc226efb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:36.708536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-970c0976-aa9a-49bf-997c-0f17fc226efb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:36.710046 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-970c0976-aa9a-49bf-997c-0f17fc226efb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:36.711182 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-970c0976-aa9a-49bf-997c-0f17fc226efb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1746 microversion: 2.20 time: 0.153816 Feb 21 04:18:36.711726 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 313/618] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:36 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:37.540393 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-cd6ced0b-38d7-406b-a4f3-66103226ff94 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:37.541025 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-cd6ced0b-38d7-406b-a4f3-66103226ff94 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:37.547214 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cd6ced0b-38d7-406b-a4f3-66103226ff94 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:37.547686 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cd6ced0b-38d7-406b-a4f3-66103226ff94 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:37.548477 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cd6ced0b-38d7-406b-a4f3-66103226ff94 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:37.548990 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cd6ced0b-38d7-406b-a4f3-66103226ff94 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:37.657964 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5cc3fcd5-f4cb-40d2-b6e4-fc91250b93ea tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0deae50>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:37.713465 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5cc3fcd5-f4cb-40d2-b6e4-fc91250b93ea tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 200 len: 345 microversion: 2.1 time: 0.060279 Feb 21 04:18:37.714417 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 314/619] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:37 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:37.729142 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-86b83509-4193-4198-961c-156bf669d44c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:37.729764 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-86b83509-4193-4198-961c-156bf669d44c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:37.735844 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-86b83509-4193-4198-961c-156bf669d44c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:37.736281 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-86b83509-4193-4198-961c-156bf669d44c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:37.737645 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-86b83509-4193-4198-961c-156bf669d44c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:37.738876 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-86b83509-4193-4198-961c-156bf669d44c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:37.809153 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-cd6ced0b-38d7-406b-a4f3-66103226ff94 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:37.817064 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-cd6ced0b-38d7-406b-a4f3-66103226ff94 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 200 len: 1505 microversion: 2.1 time: 0.280720 Feb 21 04:18:37.817656 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 306/620] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:37 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:37.829854 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-da9c05f5-05a0-4435-b3ee-09f21d2dbf56 req-1d20319b-ceda-45e8-b433-8eb5f7fe1121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c59a20-ff75-456f-99b3-070207d951d7", "name": "network-vif-plugged", "status": "completed", "tag": "ad4a893e-bbd1-41d8-a92a-483868402b5b"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:37.831502 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:18:37.831502 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:18:37.838244 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-da9c05f5-05a0-4435-b3ee-09f21d2dbf56 req-1d20319b-ceda-45e8-b433-8eb5f7fe1121 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:37.838677 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-da9c05f5-05a0-4435-b3ee-09f21d2dbf56 req-1d20319b-ceda-45e8-b433-8eb5f7fe1121 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:37.850888 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-da9c05f5-05a0-4435-b3ee-09f21d2dbf56 req-1d20319b-ceda-45e8-b433-8eb5f7fe1121 service nova] Creating event network-vif-plugged:ad4a893e-bbd1-41d8-a92a-483868402b5b for instance c0c59a20-ff75-456f-99b3-070207d951d7 on hv-cinder-77398 Feb 21 04:18:37.855874 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-da9c05f5-05a0-4435-b3ee-09f21d2dbf56 req-1d20319b-ceda-45e8-b433-8eb5f7fe1121 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029546 Feb 21 04:18:37.856437 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 307/621] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:37.982604 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-86b83509-4193-4198-961c-156bf669d44c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:37.990653 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-86b83509-4193-4198-961c-156bf669d44c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:37.992140 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-86b83509-4193-4198-961c-156bf669d44c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:37.993299 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-86b83509-4193-4198-961c-156bf669d44c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1746 microversion: 2.20 time: 0.268068 Feb 21 04:18:37.993882 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 315/622] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:37 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1746 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:18:38.181176 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-055f7a5c-8682-4e41-a692-068f57805020 req-05772cff-cc5c-4a26-888b-3b18c6070853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebbdc95-a06a-4deb-91be-ec6dba910154", "name": "network-vif-deleted", "tag": "913f4d70-2639-4ffc-8df0-8502ed8fa105"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:38.183480 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:18:38.183480 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:18:38.191730 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-055f7a5c-8682-4e41-a692-068f57805020 req-05772cff-cc5c-4a26-888b-3b18c6070853 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:38.192175 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-055f7a5c-8682-4e41-a692-068f57805020 req-05772cff-cc5c-4a26-888b-3b18c6070853 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:38.202908 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-055f7a5c-8682-4e41-a692-068f57805020 req-05772cff-cc5c-4a26-888b-3b18c6070853 service nova] Creating event network-vif-deleted:913f4d70-2639-4ffc-8df0-8502ed8fa105 for instance 9ebbdc95-a06a-4deb-91be-ec6dba910154 on hv-cinder-77398 Feb 21 04:18:38.207591 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-055f7a5c-8682-4e41-a692-068f57805020 req-05772cff-cc5c-4a26-888b-3b18c6070853 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031221 Feb 21 04:18:38.208190 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 308/623] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:38.727128 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e4c39157-255d-440f-a080-5eece8c95e6d tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0d7fee0>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:38.754988 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-e4c39157-255d-440f-a080-5eece8c95e6d tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] HTTP exception thrown: Volume 13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 could not be found. Feb 21 04:18:38.755584 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e4c39157-255d-440f-a080-5eece8c95e6d tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Returning 404 to user: Volume 13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:38.756402 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e4c39157-255d-440f-a080-5eece8c95e6d tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 404 len: 109 microversion: 2.1 time: 0.033038 Feb 21 04:18:38.756979 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 316/624] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:38 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:18:38.767273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9476289f-9354-4f98-9b99-406320c3446d tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee19a5940>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:38.793872 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-9476289f-9354-4f98-9b99-406320c3446d tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] HTTP exception thrown: Volume 13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 could not be found. Feb 21 04:18:38.794455 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9476289f-9354-4f98-9b99-406320c3446d tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Returning 404 to user: Volume 13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:38.795251 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9476289f-9354-4f98-9b99-406320c3446d tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "DELETE /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 404 len: 109 microversion: 2.1 time: 0.032497 Feb 21 04:18:38.795772 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 309/625] 10.222.0.10 () {58 vars in 1247 bytes} [Mon Feb 21 04:18:38 2022] DELETE /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:18:38.803491 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-cc4a00da-fd39-44c5-a0de-13911898b722 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Calling method '.version_select at 0x7feee0dad3a0>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:38.829982 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-cc4a00da-fd39-44c5-a0de-13911898b722 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] HTTP exception thrown: Volume 13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 could not be found. Feb 21 04:18:38.831191 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-cc4a00da-fd39-44c5-a0de-13911898b722 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] Returning 404 to user: Volume 13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:38.832027 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-cc4a00da-fd39-44c5-a0de-13911898b722 tempest-VolumesSnapshotsTestJSON-736763205 tempest-VolumesSnapshotsTestJSON-736763205-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3" status: 404 len: 109 microversion: 2.1 time: 0.032197 Feb 21 04:18:38.833299 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 317/626] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:38 2022] GET /compute/v2.1/os-volumes/13cdbcb5-cf64-48a2-a9b7-a9f819ddc1d3 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:18:38.834271 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-90e481f1-608b-46ef-8660-fbdc8f852986 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:38.835004 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-90e481f1-608b-46ef-8660-fbdc8f852986 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 9ebbdc95-a06a-4deb-91be-ec6dba910154] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:38.841754 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-90e481f1-608b-46ef-8660-fbdc8f852986 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:38.842207 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-90e481f1-608b-46ef-8660-fbdc8f852986 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:38.843019 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-90e481f1-608b-46ef-8660-fbdc8f852986 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:38.843468 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-90e481f1-608b-46ef-8660-fbdc8f852986 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:38.856962 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-90e481f1-608b-46ef-8660-fbdc8f852986 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] HTTP exception thrown: Instance 9ebbdc95-a06a-4deb-91be-ec6dba910154 could not be found. Feb 21 04:18:38.857551 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-90e481f1-608b-46ef-8660-fbdc8f852986 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Returning 404 to user: Instance 9ebbdc95-a06a-4deb-91be-ec6dba910154 could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:38.858378 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-90e481f1-608b-46ef-8660-fbdc8f852986 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154" status: 404 len: 111 microversion: 2.1 time: 0.028270 Feb 21 04:18:38.858922 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 310/627] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:38 2022] GET /compute/v2.1/servers/9ebbdc95-a06a-4deb-91be-ec6dba910154 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 04:18:38.963817 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-361372515", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "networks": [{"uuid": "1696394a-e11c-40a2-ae99-8cf4069591fe"}]}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:39.011338 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-15c1080d-161a-4f06-a351-f76e8c460d89 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:39.012171 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-15c1080d-161a-4f06-a351-f76e8c460d89 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:39.021137 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.network.neutron [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] validate_networks() for [('1696394a-e11c-40a2-ae99-8cf4069591fe', None, None, None, None, None)] {{(pid=116571) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:18:39.028598 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-15c1080d-161a-4f06-a351-f76e8c460d89 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:39.029077 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-15c1080d-161a-4f06-a351-f76e8c460d89 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:39.029862 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-15c1080d-161a-4f06-a351-f76e8c460d89 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:39.030289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-15c1080d-161a-4f06-a351-f76e8c460d89 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:39.254703 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-15c1080d-161a-4f06-a351-f76e8c460d89 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:39.262732 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-15c1080d-161a-4f06-a351-f76e8c460d89 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:39.264224 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-15c1080d-161a-4f06-a351-f76e8c460d89 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:39.265403 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-15c1080d-161a-4f06-a351-f76e8c460d89 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1746 microversion: 2.20 time: 0.258095 Feb 21 04:18:39.276066 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 311/628] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:39 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1746 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:39.281141 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-20904c19-7913-499e-b71c-ea9aee9d8eea tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:39.281717 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-20904c19-7913-499e-b71c-ea9aee9d8eea tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:39.289092 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-20904c19-7913-499e-b71c-ea9aee9d8eea tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:39.289545 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-20904c19-7913-499e-b71c-ea9aee9d8eea tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:39.290330 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-20904c19-7913-499e-b71c-ea9aee9d8eea tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:39.290877 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-20904c19-7913-499e-b71c-ea9aee9d8eea tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:39.384830 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-20904c19-7913-499e-b71c-ea9aee9d8eea tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lazy-loading 'services' on Instance uuid c4bf519a-d7d3-4837-9967-170c581923b9 {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:18:39.486592 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Flavor limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:18:39.488051 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Image limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:18:39.488835 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Flavor pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:18:39.489302 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Image pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:18:39.489715 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:18:39.494828 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-20904c19-7913-499e-b71c-ea9aee9d8eea tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "DELETE /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9/os-volume_attachments/47a59b31-c36d-4858-99e9-315432c3710a" status: 202 len: 0 microversion: 2.1 time: 0.227199 Feb 21 04:18:39.498911 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 312/629] 10.222.0.10 () {58 vars in 1415 bytes} [Mon Feb 21 04:18:39 2022] DELETE /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9/os-volume_attachments/47a59b31-c36d-4858-99e9-315432c3710a => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:18:39.499508 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:39.499637 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:39.500358 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:39.500921 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:39.522901 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Getting quotas for project 4bc69f57ebac4d74adf046561c782bbe. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:18:39.527378 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Getting quotas for user 7d514193abb7427b82557293606d20f6 and project 4bc69f57ebac4d74adf046561c782bbe. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:18:39.545699 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Going to run 1 instances... {{(pid=116571) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:18:39.550634 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:18:39.615087 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-486db9ed-6d84-486f-96f8-9a57f53f6b74 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654812 Feb 21 04:18:39.615955 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 318/630] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:18:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:18:39.639518 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-af2e6824-a500-43f1-90a8-adc2e5f99473 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:39.640226 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-af2e6824-a500-43f1-90a8-adc2e5f99473 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:39.710738 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-af2e6824-a500-43f1-90a8-adc2e5f99473 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:39.717359 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-af2e6824-a500-43f1-90a8-adc2e5f99473 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1213 microversion: 2.1 time: 0.094380 Feb 21 04:18:39.718011 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 313/631] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:39 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:40.284852 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1e0019ab-04dd-4d4a-bc6f-c47ee7521a2f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:40.285546 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1e0019ab-04dd-4d4a-bc6f-c47ee7521a2f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:40.293085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1e0019ab-04dd-4d4a-bc6f-c47ee7521a2f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:40.293687 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1e0019ab-04dd-4d4a-bc6f-c47ee7521a2f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:40.294427 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1e0019ab-04dd-4d4a-bc6f-c47ee7521a2f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:40.294855 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1e0019ab-04dd-4d4a-bc6f-c47ee7521a2f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:40.340702 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-43f9faf7-31aa-4e14-bf22-66728ea88a5d tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] Action: 'create', calling method: .version_select at 0x7feee0e9d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1896526731", "metadata": {"Type": "work"}}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:40.430220 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1e0019ab-04dd-4d4a-bc6f-c47ee7521a2f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:40.438618 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1e0019ab-04dd-4d4a-bc6f-c47ee7521a2f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:40.440840 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1e0019ab-04dd-4d4a-bc6f-c47ee7521a2f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:40.442062 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1e0019ab-04dd-4d4a-bc6f-c47ee7521a2f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1746 microversion: 2.20 time: 0.162381 Feb 21 04:18:40.442699 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 314/632] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:40 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:40.634840 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-43f9faf7-31aa-4e14-bf22-66728ea88a5d tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] 10.222.0.10 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.413472 Feb 21 04:18:40.635627 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 319/633] 10.222.0.10 () {60 vars in 1155 bytes} [Mon Feb 21 04:18:40 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 415 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 21 04:18:40.649066 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-324741a9-3c60-43c8-82b7-9fdd633c196f tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] Calling method '.version_select at 0x7feee1491430>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:40.701354 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-324741a9-3c60-43c8-82b7-9fdd633c196f tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/e8234f98-f418-4b64-9fb9-982326f77b0d" status: 200 len: 353 microversion: 2.1 time: 0.058796 Feb 21 04:18:40.701925 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 315/634] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:40 2022] GET /compute/v2.1/os-volumes/e8234f98-f418-4b64-9fb9-982326f77b0d => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:40.737468 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-63147128-17a5-4edd-b186-78add9934ad9 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:40.737781 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-63147128-17a5-4edd-b186-78add9934ad9 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:40.746116 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-63147128-17a5-4edd-b186-78add9934ad9 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:40.747318 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-63147128-17a5-4edd-b186-78add9934ad9 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:40.747971 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-63147128-17a5-4edd-b186-78add9934ad9 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:40.748952 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-63147128-17a5-4edd-b186-78add9934ad9 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:40.824354 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-63147128-17a5-4edd-b186-78add9934ad9 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:40.832301 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-63147128-17a5-4edd-b186-78add9934ad9 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1283 microversion: 2.1 time: 0.101490 Feb 21 04:18:40.832885 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 320/635] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:40 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1283 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:41.460067 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-cf6ca519-956b-406e-a375-9548fa6556bb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:41.460780 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-cf6ca519-956b-406e-a375-9548fa6556bb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:41.466488 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cf6ca519-956b-406e-a375-9548fa6556bb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:41.466931 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cf6ca519-956b-406e-a375-9548fa6556bb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:41.467723 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cf6ca519-956b-406e-a375-9548fa6556bb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:41.468151 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cf6ca519-956b-406e-a375-9548fa6556bb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:41.683727 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-cf6ca519-956b-406e-a375-9548fa6556bb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:41.702062 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-cf6ca519-956b-406e-a375-9548fa6556bb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:41.703652 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-cf6ca519-956b-406e-a375-9548fa6556bb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:41.704967 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-cf6ca519-956b-406e-a375-9548fa6556bb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1746 microversion: 2.20 time: 0.249537 Feb 21 04:18:41.706943 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 316/636] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:41 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1746 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:41.713841 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-66d1a916-3f99-4064-95cc-593e480639b3 tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] Calling method '.version_select at 0x7feee0fab040>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:41.764490 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-66d1a916-3f99-4064-95cc-593e480639b3 tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/e8234f98-f418-4b64-9fb9-982326f77b0d" status: 200 len: 354 microversion: 2.1 time: 0.054126 Feb 21 04:18:41.765152 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 321/637] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:41 2022] GET /compute/v2.1/os-volumes/e8234f98-f418-4b64-9fb9-982326f77b0d => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:41.776190 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4bb5c926-320c-4247-8e41-3b15da9bcbe3 tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] Calling method '.version_select at 0x7feee14913a0>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:41.821687 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4bb5c926-320c-4247-8e41-3b15da9bcbe3 tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/e8234f98-f418-4b64-9fb9-982326f77b0d" status: 200 len: 354 microversion: 2.1 time: 0.049423 Feb 21 04:18:41.822286 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 317/638] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:41 2022] GET /compute/v2.1/os-volumes/e8234f98-f418-4b64-9fb9-982326f77b0d => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:41.833406 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d91d25e7-aa74-4735-9014-a6817d5f7d72 tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] Calling method '.version_select at 0x7feee0d92ee0>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:41.850000 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-97815800-bb62-4a58-aa4a-a29e321933a8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:41.850612 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-97815800-bb62-4a58-aa4a-a29e321933a8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:41.856498 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-97815800-bb62-4a58-aa4a-a29e321933a8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:41.857083 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-97815800-bb62-4a58-aa4a-a29e321933a8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:41.857747 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-97815800-bb62-4a58-aa4a-a29e321933a8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:41.858178 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-97815800-bb62-4a58-aa4a-a29e321933a8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:41.895291 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d91d25e7-aa74-4735-9014-a6817d5f7d72 tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] 10.222.0.10 "DELETE /compute/v2.1/os-volumes/e8234f98-f418-4b64-9fb9-982326f77b0d" status: 202 len: 0 microversion: 2.1 time: 0.065328 Feb 21 04:18:41.895905 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 322/639] 10.222.0.10 () {58 vars in 1247 bytes} [Mon Feb 21 04:18:41 2022] DELETE /compute/v2.1/os-volumes/e8234f98-f418-4b64-9fb9-982326f77b0d => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 04:18:41.903723 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-cd1f163e-c5a9-485f-ba82-396309b0a9f9 tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] Calling method '.version_select at 0x7feee0e0fee0>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:41.954438 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-cd1f163e-c5a9-485f-ba82-396309b0a9f9 tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/e8234f98-f418-4b64-9fb9-982326f77b0d" status: 200 len: 353 microversion: 2.1 time: 0.054354 Feb 21 04:18:41.955012 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 323/640] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:41 2022] GET /compute/v2.1/os-volumes/e8234f98-f418-4b64-9fb9-982326f77b0d => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:42.223633 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-4c4bba32-b678-4c9b-bc69-a6873e9d3678 req-85fcf4d6-0460-4a59-9692-c692a67cdfce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce2584f-e283-4a21-9f5a-ff65156c3134", "tag": "6a28ec8f-dde8-4a3b-a275-da59e9456f43"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:42.225375 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:18:42.225375 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:18:42.238523 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-4c4bba32-b678-4c9b-bc69-a6873e9d3678 req-85fcf4d6-0460-4a59-9692-c692a67cdfce service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:42.239298 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-4c4bba32-b678-4c9b-bc69-a6873e9d3678 req-85fcf4d6-0460-4a59-9692-c692a67cdfce service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:42.251212 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-4c4bba32-b678-4c9b-bc69-a6873e9d3678 req-85fcf4d6-0460-4a59-9692-c692a67cdfce service nova] Creating event network-changed:6a28ec8f-dde8-4a3b-a275-da59e9456f43 for instance 8ce2584f-e283-4a21-9f5a-ff65156c3134 on hv-cinder-77398 Feb 21 04:18:42.257344 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-4c4bba32-b678-4c9b-bc69-a6873e9d3678 req-85fcf4d6-0460-4a59-9692-c692a67cdfce service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038408 Feb 21 04:18:42.258084 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 324/641] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:42.329027 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-97815800-bb62-4a58-aa4a-a29e321933a8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:42.336743 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-97815800-bb62-4a58-aa4a-a29e321933a8 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.491547 Feb 21 04:18:42.337315 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 318/642] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:41 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:42.724123 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-14288358-0d7a-468f-9fcd-780197dac79d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:42.724937 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-14288358-0d7a-468f-9fcd-780197dac79d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:42.732247 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-14288358-0d7a-468f-9fcd-780197dac79d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:42.732784 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-14288358-0d7a-468f-9fcd-780197dac79d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:42.733762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-14288358-0d7a-468f-9fcd-780197dac79d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:42.734208 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-14288358-0d7a-468f-9fcd-780197dac79d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:42.966824 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-64a773a6-7c3b-410f-bcf3-a0e9ff527279 tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] Calling method '.version_select at 0x7feee147d700>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:42.996115 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-14288358-0d7a-468f-9fcd-780197dac79d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:43.000945 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-64a773a6-7c3b-410f-bcf3-a0e9ff527279 tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] HTTP exception thrown: Volume e8234f98-f418-4b64-9fb9-982326f77b0d could not be found. Feb 21 04:18:43.002071 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-64a773a6-7c3b-410f-bcf3-a0e9ff527279 tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] Returning 404 to user: Volume e8234f98-f418-4b64-9fb9-982326f77b0d could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:43.003857 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-64a773a6-7c3b-410f-bcf3-a0e9ff527279 tempest-VolumesGetTestJSON-1604742685 tempest-VolumesGetTestJSON-1604742685-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/e8234f98-f418-4b64-9fb9-982326f77b0d" status: 404 len: 109 microversion: 2.1 time: 0.040671 Feb 21 04:18:43.004546 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 319/643] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:42 2022] GET /compute/v2.1/os-volumes/e8234f98-f418-4b64-9fb9-982326f77b0d => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 04:18:43.011697 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-14288358-0d7a-468f-9fcd-780197dac79d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:43.013868 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-14288358-0d7a-468f-9fcd-780197dac79d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:43.016376 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-14288358-0d7a-468f-9fcd-780197dac79d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1746 microversion: 2.20 time: 0.296647 Feb 21 04:18:43.016964 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 325/644] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:42 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1746 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:43.353878 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c22fde45-ac62-406e-80f8-07e66538ec32 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:43.354486 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c22fde45-ac62-406e-80f8-07e66538ec32 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:43.361117 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c22fde45-ac62-406e-80f8-07e66538ec32 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:43.361550 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c22fde45-ac62-406e-80f8-07e66538ec32 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:43.362918 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c22fde45-ac62-406e-80f8-07e66538ec32 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:43.363353 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c22fde45-ac62-406e-80f8-07e66538ec32 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:43.516787 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c22fde45-ac62-406e-80f8-07e66538ec32 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:43.525154 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c22fde45-ac62-406e-80f8-07e66538ec32 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.174881 Feb 21 04:18:43.525618 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 320/645] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:43 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:44.035918 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-dbdaddfd-b5e3-4c24-8420-a4765f798d8b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:44.036583 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-dbdaddfd-b5e3-4c24-8420-a4765f798d8b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:44.043783 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dbdaddfd-b5e3-4c24-8420-a4765f798d8b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:44.044617 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dbdaddfd-b5e3-4c24-8420-a4765f798d8b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:44.045628 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dbdaddfd-b5e3-4c24-8420-a4765f798d8b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:44.046272 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dbdaddfd-b5e3-4c24-8420-a4765f798d8b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:44.220620 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dbdaddfd-b5e3-4c24-8420-a4765f798d8b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:44.228936 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dbdaddfd-b5e3-4c24-8420-a4765f798d8b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:44.230869 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dbdaddfd-b5e3-4c24-8420-a4765f798d8b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:44.232399 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-dbdaddfd-b5e3-4c24-8420-a4765f798d8b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1741 microversion: 2.20 time: 0.200926 Feb 21 04:18:44.233607 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 326/646] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:44 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:44.543869 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-89cf2c8e-a4de-4168-8b4a-6f4615076829 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:44.544340 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-89cf2c8e-a4de-4168-8b4a-6f4615076829 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:44.557280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-89cf2c8e-a4de-4168-8b4a-6f4615076829 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:44.557766 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-89cf2c8e-a4de-4168-8b4a-6f4615076829 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:44.558554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-89cf2c8e-a4de-4168-8b4a-6f4615076829 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:44.558981 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-89cf2c8e-a4de-4168-8b4a-6f4615076829 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:44.773045 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-89cf2c8e-a4de-4168-8b4a-6f4615076829 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:44.786416 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-89cf2c8e-a4de-4168-8b4a-6f4615076829 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.246568 Feb 21 04:18:44.795998 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 321/647] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:44 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:45.066417 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4586b0d0-a838-4b61-b000-fbc40551bd1c tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] Action: 'create', calling method: .version_select at 0x7feee0e9d700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-945661723", "metadata": {"Type": "work"}}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:45.070674 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4586b0d0-a838-4b61-b000-fbc40551bd1c tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:45.075239 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4586b0d0-a838-4b61-b000-fbc40551bd1c tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] 10.222.0.10 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.399374 Feb 21 04:18:45.076280 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 327/648] 10.222.0.10 () {60 vars in 1155 bytes} [Mon Feb 21 04:18:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 404 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 04:18:45.086650 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a2cc8f58-5ab3-4cff-b227-0a05bb795dac tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] Action: 'create', calling method: .version_select at 0x7feee16c34c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1314582991", "metadata": {"Type": "work"}}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:45.089706 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a2cc8f58-5ab3-4cff-b227-0a05bb795dac tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:45.090910 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a2cc8f58-5ab3-4cff-b227-0a05bb795dac tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] 10.222.0.10 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009134 Feb 21 04:18:45.092143 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 322/649] 10.222.0.10 () {60 vars in 1155 bytes} [Mon Feb 21 04:18:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 04:18:45.101325 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c28f904a-9c84-407b-96e0-dc7ab99ce840 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] Action: 'create', calling method: .version_select at 0x7feee0de68b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2079755300", "metadata": {"Type": "work"}}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:45.102481 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c28f904a-9c84-407b-96e0-dc7ab99ce840 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:45.109014 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c28f904a-9c84-407b-96e0-dc7ab99ce840 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] 10.222.0.10 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011208 Feb 21 04:18:45.109566 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 328/650] 10.222.0.10 () {60 vars in 1155 bytes} [Mon Feb 21 04:18:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 21 04:18:45.120145 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-86234467-486d-45b3-b4a5-3a80b95a4616 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] Calling method '.version_select at 0x7feee1990e50>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:45.168596 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-86234467-486d-45b3-b4a5-3a80b95a4616 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] HTTP exception thrown: Volume tempest-invalid-1118738282 could not be found. Feb 21 04:18:45.169845 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-86234467-486d-45b3-b4a5-3a80b95a4616 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] Returning 404 to user: Volume tempest-invalid-1118738282 could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:45.170810 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-86234467-486d-45b3-b4a5-3a80b95a4616 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] 10.222.0.10 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1118738282" status: 404 len: 99 microversion: 2.1 time: 0.055643 Feb 21 04:18:45.171484 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 323/651] 10.222.0.10 () {58 vars in 1217 bytes} [Mon Feb 21 04:18:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1118738282 => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 21 04:18:45.183466 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a3ade91a-7c3e-424d-bc33-d4c0fe9b0928 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] 10.222.0.10 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005482 Feb 21 04:18:45.191879 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 329/652] 10.222.0.10 () {58 vars in 1139 bytes} [Mon Feb 21 04:18:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 21 04:18:45.195646 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-61dbeb3d-dc60-4434-97db-2d535027444d tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004539 Feb 21 04:18:45.196202 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 324/653] 10.222.0.10 () {58 vars in 1136 bytes} [Mon Feb 21 04:18:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 21 04:18:45.206167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a6e7d503-c808-4ff2-80ce-ceb6d214cab0 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] Calling method '.version_select at 0x7feee0de6e50>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:45.236368 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-a6e7d503-c808-4ff2-80ce-ceb6d214cab0 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] HTTP exception thrown: Volume 9dd9086a-5188-4339-9c69-f44b975e7bd5 could not be found. Feb 21 04:18:45.237767 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a6e7d503-c808-4ff2-80ce-ceb6d214cab0 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] Returning 404 to user: Volume 9dd9086a-5188-4339-9c69-f44b975e7bd5 could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:45.238704 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a6e7d503-c808-4ff2-80ce-ceb6d214cab0 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] 10.222.0.10 "DELETE /compute/v2.1/os-volumes/9dd9086a-5188-4339-9c69-f44b975e7bd5" status: 404 len: 109 microversion: 2.1 time: 0.036785 Feb 21 04:18:45.239768 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 330/654] 10.222.0.10 () {58 vars in 1247 bytes} [Mon Feb 21 04:18:45 2022] DELETE /compute/v2.1/os-volumes/9dd9086a-5188-4339-9c69-f44b975e7bd5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:18:45.252448 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-77701341-ca42-473b-a7eb-8c9eedf052c2 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] Calling method '.version_select at 0x7feee14c6940>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:45.301014 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-be5d6605-28e2-48d5-be55-f21a0a24fa77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:45.302015 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-be5d6605-28e2-48d5-be55-f21a0a24fa77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:45.319884 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-77701341-ca42-473b-a7eb-8c9eedf052c2 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] HTTP exception thrown: Volume f1419048-5b48-4292-b14e-6eabaf814235 could not be found. Feb 21 04:18:45.320760 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-be5d6605-28e2-48d5-be55-f21a0a24fa77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:45.321277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-be5d6605-28e2-48d5-be55-f21a0a24fa77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:45.322206 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-be5d6605-28e2-48d5-be55-f21a0a24fa77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:45.322598 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-77701341-ca42-473b-a7eb-8c9eedf052c2 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] Returning 404 to user: Volume f1419048-5b48-4292-b14e-6eabaf814235 could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:45.324088 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-77701341-ca42-473b-a7eb-8c9eedf052c2 tempest-VolumesNegativeTest-395168236 tempest-VolumesNegativeTest-395168236-project] 10.222.0.10 "GET /compute/v2.1/os-volumes/f1419048-5b48-4292-b14e-6eabaf814235" status: 404 len: 109 microversion: 2.1 time: 0.076511 Feb 21 04:18:45.324269 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-be5d6605-28e2-48d5-be55-f21a0a24fa77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:45.341790 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 325/655] 10.222.0.10 () {58 vars in 1244 bytes} [Mon Feb 21 04:18:45 2022] GET /compute/v2.1/os-volumes/f1419048-5b48-4292-b14e-6eabaf814235 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:18:45.519242 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-be5d6605-28e2-48d5-be55-f21a0a24fa77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:45.528976 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-be5d6605-28e2-48d5-be55-f21a0a24fa77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:45.530964 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-be5d6605-28e2-48d5-be55-f21a0a24fa77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:45.532324 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-be5d6605-28e2-48d5-be55-f21a0a24fa77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1741 microversion: 2.20 time: 0.275679 Feb 21 04:18:45.544678 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 331/656] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:45 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1741 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:45.803948 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6991fbda-e9e5-42c1-bf34-7809babe2b95 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:45.805094 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6991fbda-e9e5-42c1-bf34-7809babe2b95 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:45.818272 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6991fbda-e9e5-42c1-bf34-7809babe2b95 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:45.818727 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6991fbda-e9e5-42c1-bf34-7809babe2b95 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:45.819526 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6991fbda-e9e5-42c1-bf34-7809babe2b95 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:45.819965 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6991fbda-e9e5-42c1-bf34-7809babe2b95 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:46.043845 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-877c9981-dc2a-4bd5-b28b-8aa8a8df7524 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:46.044607 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-877c9981-dc2a-4bd5-b28b-8aa8a8df7524 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:46.063661 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-877c9981-dc2a-4bd5-b28b-8aa8a8df7524 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:46.065568 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-877c9981-dc2a-4bd5-b28b-8aa8a8df7524 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:46.068938 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-877c9981-dc2a-4bd5-b28b-8aa8a8df7524 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:46.069604 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-877c9981-dc2a-4bd5-b28b-8aa8a8df7524 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:46.125921 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-877c9981-dc2a-4bd5-b28b-8aa8a8df7524 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Going to try to terminate instance {{(pid=116571) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:18:46.262094 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-877c9981-dc2a-4bd5-b28b-8aa8a8df7524 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "DELETE /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 204 len: 0 microversion: 2.1 time: 0.223126 Feb 21 04:18:46.262900 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 332/657] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:18:46 2022] DELETE /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 04:18:46.268796 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e66a7335-f88d-467a-b854-9c2aff869e0a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:46.269898 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e66a7335-f88d-467a-b854-9c2aff869e0a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:46.278570 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e66a7335-f88d-467a-b854-9c2aff869e0a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:46.279293 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e66a7335-f88d-467a-b854-9c2aff869e0a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:46.280623 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e66a7335-f88d-467a-b854-9c2aff869e0a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:46.281254 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e66a7335-f88d-467a-b854-9c2aff869e0a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:46.314286 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6991fbda-e9e5-42c1-bf34-7809babe2b95 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:46.326554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6991fbda-e9e5-42c1-bf34-7809babe2b95 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.527155 Feb 21 04:18:46.327187 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 326/658] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:45 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:46.336847 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-aa323e9e-ae47-4d35-b968-364f972d18a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:46.338260 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-aa323e9e-ae47-4d35-b968-364f972d18a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:46.347159 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aa323e9e-ae47-4d35-b968-364f972d18a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:46.348515 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aa323e9e-ae47-4d35-b968-364f972d18a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:46.349589 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aa323e9e-ae47-4d35-b968-364f972d18a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:46.350612 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aa323e9e-ae47-4d35-b968-364f972d18a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:46.420533 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-e66a7335-f88d-467a-b854-9c2aff869e0a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lazy-loading 'services' on Instance uuid c8f1fe68-8efa-45ce-8c76-671456eca8ec {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:18:46.601718 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e66a7335-f88d-467a-b854-9c2aff869e0a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "DELETE /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec/os-volume_attachments/9c2facd8-9e5d-40a8-97dd-bc565d1e7515" status: 202 len: 0 microversion: 2.1 time: 0.337213 Feb 21 04:18:46.606203 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 333/659] 10.222.0.10 () {58 vars in 1415 bytes} [Mon Feb 21 04:18:46 2022] DELETE /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec/os-volume_attachments/9c2facd8-9e5d-40a8-97dd-bc565d1e7515 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:18:46.615694 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-675aea87-5b5a-4881-a174-956ae1073e4c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:46.618541 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-675aea87-5b5a-4881-a174-956ae1073e4c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:46.649277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-675aea87-5b5a-4881-a174-956ae1073e4c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:46.650075 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-675aea87-5b5a-4881-a174-956ae1073e4c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:46.652604 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-675aea87-5b5a-4881-a174-956ae1073e4c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:46.654057 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-675aea87-5b5a-4881-a174-956ae1073e4c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:46.655914 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-aa323e9e-ae47-4d35-b968-364f972d18a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:46.665550 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-aa323e9e-ae47-4d35-b968-364f972d18a2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1514 microversion: 2.1 time: 0.336592 Feb 21 04:18:46.666990 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 327/660] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:46 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1514 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:46.672426 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9f628586-8176-44b0-94fc-280899bba4bb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:46.673572 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9f628586-8176-44b0-94fc-280899bba4bb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:46.680583 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9f628586-8176-44b0-94fc-280899bba4bb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:46.681312 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9f628586-8176-44b0-94fc-280899bba4bb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:46.682267 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9f628586-8176-44b0-94fc-280899bba4bb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:46.682855 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9f628586-8176-44b0-94fc-280899bba4bb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:46.742860 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9f628586-8176-44b0-94fc-280899bba4bb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074409 Feb 21 04:18:46.743478 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 328/661] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:18:46 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:46.858936 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-675aea87-5b5a-4881-a174-956ae1073e4c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:46.882775 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-675aea87-5b5a-4881-a174-956ae1073e4c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:46.892471 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-675aea87-5b5a-4881-a174-956ae1073e4c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:46.894161 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-675aea87-5b5a-4881-a174-956ae1073e4c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1741 microversion: 2.20 time: 0.285818 Feb 21 04:18:46.905460 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 334/662] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:46 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1741 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:47.343033 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-22332fd8-8d30-4c05-9c49-0cc793807f88 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:47.345476 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-22332fd8-8d30-4c05-9c49-0cc793807f88 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:47.355629 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-22332fd8-8d30-4c05-9c49-0cc793807f88 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:47.356539 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-22332fd8-8d30-4c05-9c49-0cc793807f88 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:47.361811 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-22332fd8-8d30-4c05-9c49-0cc793807f88 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:47.363361 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-22332fd8-8d30-4c05-9c49-0cc793807f88 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:47.616144 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-22332fd8-8d30-4c05-9c49-0cc793807f88 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:47.628791 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-22332fd8-8d30-4c05-9c49-0cc793807f88 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.287475 Feb 21 04:18:47.642189 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 329/663] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:47 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:47.683096 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-680f3217-8170-4e81-9f74-636f16bc2630 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:47.683697 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-680f3217-8170-4e81-9f74-636f16bc2630 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:47.694716 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-680f3217-8170-4e81-9f74-636f16bc2630 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:47.701182 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-680f3217-8170-4e81-9f74-636f16bc2630 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:47.702138 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-680f3217-8170-4e81-9f74-636f16bc2630 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:47.702585 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-680f3217-8170-4e81-9f74-636f16bc2630 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:47.754408 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-bfb29dc1-4f48-40b2-bdff-f2cd6c769ae0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:47.755641 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-bfb29dc1-4f48-40b2-bdff-f2cd6c769ae0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:47.771957 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bfb29dc1-4f48-40b2-bdff-f2cd6c769ae0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:47.775972 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bfb29dc1-4f48-40b2-bdff-f2cd6c769ae0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:47.776981 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bfb29dc1-4f48-40b2-bdff-f2cd6c769ae0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:47.778915 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bfb29dc1-4f48-40b2-bdff-f2cd6c769ae0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:47.858723 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-bfb29dc1-4f48-40b2-bdff-f2cd6c769ae0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107201 Feb 21 04:18:47.859523 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 330/664] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:18:47 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 04:18:47.915235 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-16fc39e9-0d3b-4bda-9eb8-742d1a40d385 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:47.917289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-16fc39e9-0d3b-4bda-9eb8-742d1a40d385 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:47.931427 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16fc39e9-0d3b-4bda-9eb8-742d1a40d385 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:47.932250 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16fc39e9-0d3b-4bda-9eb8-742d1a40d385 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:47.933336 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16fc39e9-0d3b-4bda-9eb8-742d1a40d385 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:47.933931 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16fc39e9-0d3b-4bda-9eb8-742d1a40d385 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:48.105623 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-680f3217-8170-4e81-9f74-636f16bc2630 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:48.120581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-680f3217-8170-4e81-9f74-636f16bc2630 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1514 microversion: 2.1 time: 0.439102 Feb 21 04:18:48.123966 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 335/665] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:47 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1514 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:48.239493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-16fc39e9-0d3b-4bda-9eb8-742d1a40d385 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:48.248880 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-16fc39e9-0d3b-4bda-9eb8-742d1a40d385 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:48.256037 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-16fc39e9-0d3b-4bda-9eb8-742d1a40d385 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:48.262228 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-16fc39e9-0d3b-4bda-9eb8-742d1a40d385 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1741 microversion: 2.20 time: 0.353802 Feb 21 04:18:48.262802 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 331/666] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:47 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1741 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:18:48.648821 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-565a3b29-aeeb-49cd-9c27-d6b0aace49d3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:48.649844 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-565a3b29-aeeb-49cd-9c27-d6b0aace49d3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:48.663216 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-565a3b29-aeeb-49cd-9c27-d6b0aace49d3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:48.665175 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-565a3b29-aeeb-49cd-9c27-d6b0aace49d3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:48.668799 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-565a3b29-aeeb-49cd-9c27-d6b0aace49d3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:48.669502 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-565a3b29-aeeb-49cd-9c27-d6b0aace49d3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:49.104841 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-565a3b29-aeeb-49cd-9c27-d6b0aace49d3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:49.114922 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-565a3b29-aeeb-49cd-9c27-d6b0aace49d3 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.471313 Feb 21 04:18:49.116540 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 336/667] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:48 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:49.138698 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e6c8150a-08af-4fcc-8374-4b7bf90c07ba tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:49.139958 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e6c8150a-08af-4fcc-8374-4b7bf90c07ba tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:49.164309 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6c8150a-08af-4fcc-8374-4b7bf90c07ba tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:49.166008 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6c8150a-08af-4fcc-8374-4b7bf90c07ba tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:49.168741 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6c8150a-08af-4fcc-8374-4b7bf90c07ba tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:49.169391 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6c8150a-08af-4fcc-8374-4b7bf90c07ba tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:49.209437 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f3e320b8-66e3-4611-8d54-e7170bd09ce8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:49.209932 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f3e320b8-66e3-4611-8d54-e7170bd09ce8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:49.225346 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f3e320b8-66e3-4611-8d54-e7170bd09ce8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:49.229192 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f3e320b8-66e3-4611-8d54-e7170bd09ce8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:49.235187 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f3e320b8-66e3-4611-8d54-e7170bd09ce8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:49.235831 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f3e320b8-66e3-4611-8d54-e7170bd09ce8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:49.272193 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f3e320b8-66e3-4611-8d54-e7170bd09ce8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Going to try to terminate instance {{(pid=116571) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:18:49.410757 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f3e320b8-66e3-4611-8d54-e7170bd09ce8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "DELETE /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 204 len: 0 microversion: 2.1 time: 0.204902 Feb 21 04:18:49.414239 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 337/668] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:18:49 2022] DELETE /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 04:18:49.419418 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-27606f4d-7d5f-4dad-a97d-9240f9afae00 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:49.420840 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-27606f4d-7d5f-4dad-a97d-9240f9afae00 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:49.431064 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-27606f4d-7d5f-4dad-a97d-9240f9afae00 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:49.432917 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-27606f4d-7d5f-4dad-a97d-9240f9afae00 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:49.434977 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-27606f4d-7d5f-4dad-a97d-9240f9afae00 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:49.435969 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-27606f4d-7d5f-4dad-a97d-9240f9afae00 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:49.508987 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e6c8150a-08af-4fcc-8374-4b7bf90c07ba tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:49.523159 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e6c8150a-08af-4fcc-8374-4b7bf90c07ba tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 200 len: 1514 microversion: 2.1 time: 0.388433 Feb 21 04:18:49.524046 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 332/669] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:49 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 1514 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:49.528576 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0c7c0980-b9fe-42f8-9566-a28468397cd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:49.529487 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0c7c0980-b9fe-42f8-9566-a28468397cd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:49.544059 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0c7c0980-b9fe-42f8-9566-a28468397cd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:49.544876 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0c7c0980-b9fe-42f8-9566-a28468397cd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:49.545836 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0c7c0980-b9fe-42f8-9566-a28468397cd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:49.546264 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0c7c0980-b9fe-42f8-9566-a28468397cd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:49.751216 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-27606f4d-7d5f-4dad-a97d-9240f9afae00 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:49.763474 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-27606f4d-7d5f-4dad-a97d-9240f9afae00 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:49.766888 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-27606f4d-7d5f-4dad-a97d-9240f9afae00 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:49.770949 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-27606f4d-7d5f-4dad-a97d-9240f9afae00 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1741 microversion: 2.20 time: 0.358192 Feb 21 04:18:49.772404 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 338/670] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:49 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1741 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:49.893486 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-65e6c138-878e-4e39-9d47-257a400f6f46 req-08323371-89dd-4ea4-8251-3dafa3a561ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bf519a-d7d3-4837-9967-170c581923b9", "name": "network-vif-deleted", "tag": "e3b4314c-490f-4b92-b46a-0ebe1ed983f0"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:49.895597 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:18:49.895597 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:18:49.910549 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0c7c0980-b9fe-42f8-9566-a28468397cd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:49.913453 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-65e6c138-878e-4e39-9d47-257a400f6f46 req-08323371-89dd-4ea4-8251-3dafa3a561ec service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:49.916192 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-65e6c138-878e-4e39-9d47-257a400f6f46 req-08323371-89dd-4ea4-8251-3dafa3a561ec service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:49.918548 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0c7c0980-b9fe-42f8-9566-a28468397cd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1513 microversion: 2.1 time: 0.393504 Feb 21 04:18:49.920049 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 333/671] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:49 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1513 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:49.932605 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-65e6c138-878e-4e39-9d47-257a400f6f46 req-08323371-89dd-4ea4-8251-3dafa3a561ec service nova] Creating event network-vif-deleted:e3b4314c-490f-4b92-b46a-0ebe1ed983f0 for instance c4bf519a-d7d3-4837-9967-170c581923b9 on hv-cinder-77398 Feb 21 04:18:49.938818 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-65e6c138-878e-4e39-9d47-257a400f6f46 req-08323371-89dd-4ea4-8251-3dafa3a561ec service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049603 Feb 21 04:18:49.939581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 339/672] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:50.131818 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f0f68389-4c41-4936-b6bb-668237e6ae61 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:50.132795 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f0f68389-4c41-4936-b6bb-668237e6ae61 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:50.139033 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f0f68389-4c41-4936-b6bb-668237e6ae61 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:50.140184 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f0f68389-4c41-4936-b6bb-668237e6ae61 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:50.142302 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f0f68389-4c41-4936-b6bb-668237e6ae61 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:50.144058 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f0f68389-4c41-4936-b6bb-668237e6ae61 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:50.357235 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f0f68389-4c41-4936-b6bb-668237e6ae61 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:50.367772 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f0f68389-4c41-4936-b6bb-668237e6ae61 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.239695 Feb 21 04:18:50.368565 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 334/673] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:50 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:50.542121 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9f6a3a0c-9aeb-4183-bc12-a1f2151590b2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:50.542889 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9f6a3a0c-9aeb-4183-bc12-a1f2151590b2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: c4bf519a-d7d3-4837-9967-170c581923b9] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:50.554236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9f6a3a0c-9aeb-4183-bc12-a1f2151590b2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:50.555110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9f6a3a0c-9aeb-4183-bc12-a1f2151590b2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:50.556801 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9f6a3a0c-9aeb-4183-bc12-a1f2151590b2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:50.557434 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9f6a3a0c-9aeb-4183-bc12-a1f2151590b2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:50.575130 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-9f6a3a0c-9aeb-4183-bc12-a1f2151590b2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] HTTP exception thrown: Instance c4bf519a-d7d3-4837-9967-170c581923b9 could not be found. Feb 21 04:18:50.576017 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9f6a3a0c-9aeb-4183-bc12-a1f2151590b2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Returning 404 to user: Instance c4bf519a-d7d3-4837-9967-170c581923b9 could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:50.577061 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9f6a3a0c-9aeb-4183-bc12-a1f2151590b2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9" status: 404 len: 111 microversion: 2.1 time: 0.040230 Feb 21 04:18:50.582342 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 340/674] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:50 2022] GET /compute/v2.1/servers/c4bf519a-d7d3-4837-9967-170c581923b9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:18:50.790445 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3f356d83-15fb-4902-ada2-57e5337b942b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:50.791048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3f356d83-15fb-4902-ada2-57e5337b942b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:50.798092 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3f356d83-15fb-4902-ada2-57e5337b942b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:50.798747 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3f356d83-15fb-4902-ada2-57e5337b942b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:50.799651 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3f356d83-15fb-4902-ada2-57e5337b942b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:50.800282 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3f356d83-15fb-4902-ada2-57e5337b942b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:50.940709 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-10b1f220-cd42-4581-8e8d-ec6ca8d46d51 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:50.941468 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-10b1f220-cd42-4581-8e8d-ec6ca8d46d51 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:50.948299 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-10b1f220-cd42-4581-8e8d-ec6ca8d46d51 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:50.949103 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-10b1f220-cd42-4581-8e8d-ec6ca8d46d51 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:50.950107 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-10b1f220-cd42-4581-8e8d-ec6ca8d46d51 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:50.950730 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-10b1f220-cd42-4581-8e8d-ec6ca8d46d51 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:50.965237 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3f356d83-15fb-4902-ada2-57e5337b942b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:50.977099 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3f356d83-15fb-4902-ada2-57e5337b942b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:50.982864 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3f356d83-15fb-4902-ada2-57e5337b942b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:50.984074 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3f356d83-15fb-4902-ada2-57e5337b942b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1741 microversion: 2.20 time: 0.197573 Feb 21 04:18:50.984660 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 335/675] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:50 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:51.136142 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-10b1f220-cd42-4581-8e8d-ec6ca8d46d51 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:51.146611 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-10b1f220-cd42-4581-8e8d-ec6ca8d46d51 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1513 microversion: 2.1 time: 0.211195 Feb 21 04:18:51.155857 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 341/676] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:50 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:51.396513 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-82f9abcc-581a-4f12-a9c1-f801a50be60f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:51.397266 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-82f9abcc-581a-4f12-a9c1-f801a50be60f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:51.406653 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-82f9abcc-581a-4f12-a9c1-f801a50be60f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:51.407951 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-82f9abcc-581a-4f12-a9c1-f801a50be60f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:51.409965 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-82f9abcc-581a-4f12-a9c1-f801a50be60f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:51.410408 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-82f9abcc-581a-4f12-a9c1-f801a50be60f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:51.661537 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-82f9abcc-581a-4f12-a9c1-f801a50be60f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:51.672803 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-82f9abcc-581a-4f12-a9c1-f801a50be60f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.279063 Feb 21 04:18:51.683295 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 336/677] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:51 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:52.003525 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5ad09525-2103-4154-bee7-c6bff6214b15 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:52.006506 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5ad09525-2103-4154-bee7-c6bff6214b15 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:52.020953 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5ad09525-2103-4154-bee7-c6bff6214b15 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:52.021916 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5ad09525-2103-4154-bee7-c6bff6214b15 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:52.023148 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5ad09525-2103-4154-bee7-c6bff6214b15 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:52.024227 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5ad09525-2103-4154-bee7-c6bff6214b15 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:52.166084 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-34085715-8d79-4e13-b656-43ff576a5a59 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:52.172139 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-34085715-8d79-4e13-b656-43ff576a5a59 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:52.191767 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-34085715-8d79-4e13-b656-43ff576a5a59 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:52.192405 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-34085715-8d79-4e13-b656-43ff576a5a59 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:52.198018 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-34085715-8d79-4e13-b656-43ff576a5a59 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:52.199493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-34085715-8d79-4e13-b656-43ff576a5a59 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:52.218888 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5ad09525-2103-4154-bee7-c6bff6214b15 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:52.233917 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5ad09525-2103-4154-bee7-c6bff6214b15 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:52.240376 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5ad09525-2103-4154-bee7-c6bff6214b15 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:52.241820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5ad09525-2103-4154-bee7-c6bff6214b15 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1741 microversion: 2.20 time: 0.243490 Feb 21 04:18:52.245324 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 342/678] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:51 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1741 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:52.389259 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-34085715-8d79-4e13-b656-43ff576a5a59 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:52.398150 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-34085715-8d79-4e13-b656-43ff576a5a59 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1513 microversion: 2.1 time: 0.236104 Feb 21 04:18:52.406120 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 337/679] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:52 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:52.690342 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4d7f219b-f4c7-4dec-a81f-cb5b61c8390f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:52.690948 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4d7f219b-f4c7-4dec-a81f-cb5b61c8390f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:52.704298 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4d7f219b-f4c7-4dec-a81f-cb5b61c8390f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:52.704757 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4d7f219b-f4c7-4dec-a81f-cb5b61c8390f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:52.706089 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4d7f219b-f4c7-4dec-a81f-cb5b61c8390f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:52.706512 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4d7f219b-f4c7-4dec-a81f-cb5b61c8390f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:52.894837 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4d7f219b-f4c7-4dec-a81f-cb5b61c8390f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:52.917894 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4d7f219b-f4c7-4dec-a81f-cb5b61c8390f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.231041 Feb 21 04:18:52.928202 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 343/680] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:52 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:52.938714 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-fb8a3f64-e934-4940-8221-82eff31d4627 req-3d7e0814-b1fd-4536-ba42-53da9f55ef84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce2584f-e283-4a21-9f5a-ff65156c3134", "name": "network-vif-plugged", "status": "completed", "tag": "6a28ec8f-dde8-4a3b-a275-da59e9456f43"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:52.940362 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:18:52.940362 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:18:52.948902 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-fb8a3f64-e934-4940-8221-82eff31d4627 req-3d7e0814-b1fd-4536-ba42-53da9f55ef84 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:52.949921 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-fb8a3f64-e934-4940-8221-82eff31d4627 req-3d7e0814-b1fd-4536-ba42-53da9f55ef84 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:52.963098 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-fb8a3f64-e934-4940-8221-82eff31d4627 req-3d7e0814-b1fd-4536-ba42-53da9f55ef84 service nova] Creating event network-vif-plugged:6a28ec8f-dde8-4a3b-a275-da59e9456f43 for instance 8ce2584f-e283-4a21-9f5a-ff65156c3134 on hv-cinder-77398 Feb 21 04:18:52.969445 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-fb8a3f64-e934-4940-8221-82eff31d4627 req-3d7e0814-b1fd-4536-ba42-53da9f55ef84 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033548 Feb 21 04:18:52.970200 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 338/681] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:18:53.262959 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-58e78789-3292-47b1-b899-d5c6aa2b3ced tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:53.263580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-58e78789-3292-47b1-b899-d5c6aa2b3ced tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:53.270579 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-58e78789-3292-47b1-b899-d5c6aa2b3ced tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:53.271030 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-58e78789-3292-47b1-b899-d5c6aa2b3ced tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:53.273284 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-58e78789-3292-47b1-b899-d5c6aa2b3ced tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:53.273284 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-58e78789-3292-47b1-b899-d5c6aa2b3ced tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:53.415618 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1a0af2da-507a-4ee5-aa07-f7915d8112da tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:53.417188 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1a0af2da-507a-4ee5-aa07-f7915d8112da tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:53.423565 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1a0af2da-507a-4ee5-aa07-f7915d8112da tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:53.424051 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1a0af2da-507a-4ee5-aa07-f7915d8112da tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:53.424864 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1a0af2da-507a-4ee5-aa07-f7915d8112da tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:53.425599 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1a0af2da-507a-4ee5-aa07-f7915d8112da tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:53.443070 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-58e78789-3292-47b1-b899-d5c6aa2b3ced tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:53.452762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-58e78789-3292-47b1-b899-d5c6aa2b3ced tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:53.455815 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-58e78789-3292-47b1-b899-d5c6aa2b3ced tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:53.457045 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-58e78789-3292-47b1-b899-d5c6aa2b3ced tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1741 microversion: 2.20 time: 0.197745 Feb 21 04:18:53.461109 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 344/682] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:53 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:53.588708 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1a0af2da-507a-4ee5-aa07-f7915d8112da tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:53.596829 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1a0af2da-507a-4ee5-aa07-f7915d8112da tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1513 microversion: 2.1 time: 0.185681 Feb 21 04:18:53.598029 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 339/683] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:53 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:53.934748 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-46362d0c-1529-48ec-89c4-3a05cf7063d4 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:53.935351 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-46362d0c-1529-48ec-89c4-3a05cf7063d4 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:53.942355 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-46362d0c-1529-48ec-89c4-3a05cf7063d4 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:53.942919 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-46362d0c-1529-48ec-89c4-3a05cf7063d4 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:53.943985 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-46362d0c-1529-48ec-89c4-3a05cf7063d4 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:53.944515 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-46362d0c-1529-48ec-89c4-3a05cf7063d4 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:54.099283 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-46362d0c-1529-48ec-89c4-3a05cf7063d4 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:54.106868 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-46362d0c-1529-48ec-89c4-3a05cf7063d4 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.175750 Feb 21 04:18:54.107739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 345/684] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:53 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:54.474968 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-64123f1a-8732-468a-adfb-9c3388a5bcb6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:54.476324 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-64123f1a-8732-468a-adfb-9c3388a5bcb6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:54.483172 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-64123f1a-8732-468a-adfb-9c3388a5bcb6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:54.483880 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-64123f1a-8732-468a-adfb-9c3388a5bcb6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:54.484931 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-64123f1a-8732-468a-adfb-9c3388a5bcb6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:54.485424 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-64123f1a-8732-468a-adfb-9c3388a5bcb6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:54.615944 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b6fd15b2-87d6-427a-b59d-2a32f66bf28e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:54.616529 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b6fd15b2-87d6-427a-b59d-2a32f66bf28e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:54.626287 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b6fd15b2-87d6-427a-b59d-2a32f66bf28e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:54.626736 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b6fd15b2-87d6-427a-b59d-2a32f66bf28e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:54.627604 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b6fd15b2-87d6-427a-b59d-2a32f66bf28e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:54.628044 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b6fd15b2-87d6-427a-b59d-2a32f66bf28e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:54.661100 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-64123f1a-8732-468a-adfb-9c3388a5bcb6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:54.670080 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-64123f1a-8732-468a-adfb-9c3388a5bcb6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:54.672060 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-64123f1a-8732-468a-adfb-9c3388a5bcb6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:54.673636 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-64123f1a-8732-468a-adfb-9c3388a5bcb6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1741 microversion: 2.20 time: 0.202480 Feb 21 04:18:54.675295 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 340/685] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:54 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:54.794247 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b6fd15b2-87d6-427a-b59d-2a32f66bf28e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:54.803528 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b6fd15b2-87d6-427a-b59d-2a32f66bf28e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1513 microversion: 2.1 time: 0.192131 Feb 21 04:18:54.804607 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 346/686] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:54 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:55.123692 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-496883fb-559a-44cf-bcb1-176e26a694d7 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:55.124730 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-496883fb-559a-44cf-bcb1-176e26a694d7 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:55.131564 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-496883fb-559a-44cf-bcb1-176e26a694d7 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:55.132251 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-496883fb-559a-44cf-bcb1-176e26a694d7 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:55.133297 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-496883fb-559a-44cf-bcb1-176e26a694d7 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:55.133888 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-496883fb-559a-44cf-bcb1-176e26a694d7 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:55.289241 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-496883fb-559a-44cf-bcb1-176e26a694d7 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:55.301568 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-496883fb-559a-44cf-bcb1-176e26a694d7 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.181544 Feb 21 04:18:55.311077 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 341/687] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:55 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:55.705638 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a925ecc5-3395-4d6d-aea5-6e75dcc098c6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:55.708975 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a925ecc5-3395-4d6d-aea5-6e75dcc098c6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:55.714055 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a925ecc5-3395-4d6d-aea5-6e75dcc098c6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:55.714524 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a925ecc5-3395-4d6d-aea5-6e75dcc098c6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:55.715312 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a925ecc5-3395-4d6d-aea5-6e75dcc098c6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:55.715745 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a925ecc5-3395-4d6d-aea5-6e75dcc098c6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:55.820895 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-940b1592-38ce-46bf-9e0f-8e987e0037ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:55.822178 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-940b1592-38ce-46bf-9e0f-8e987e0037ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:55.829276 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-940b1592-38ce-46bf-9e0f-8e987e0037ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:55.830435 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-940b1592-38ce-46bf-9e0f-8e987e0037ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:55.831536 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-940b1592-38ce-46bf-9e0f-8e987e0037ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:55.832084 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-940b1592-38ce-46bf-9e0f-8e987e0037ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:55.915264 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a925ecc5-3395-4d6d-aea5-6e75dcc098c6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:55.925596 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a925ecc5-3395-4d6d-aea5-6e75dcc098c6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:55.927615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a925ecc5-3395-4d6d-aea5-6e75dcc098c6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:55.929338 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a925ecc5-3395-4d6d-aea5-6e75dcc098c6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1741 microversion: 2.20 time: 0.240080 Feb 21 04:18:55.930484 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 347/688] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:55 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1741 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:56.041178 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-940b1592-38ce-46bf-9e0f-8e987e0037ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:56.049178 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-940b1592-38ce-46bf-9e0f-8e987e0037ad tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1513 microversion: 2.1 time: 0.231320 Feb 21 04:18:56.058370 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 342/689] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:55 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:18:56.317974 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8c06e5fd-3d89-431d-9918-f6719a02943b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:56.319161 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-8c06e5fd-3d89-431d-9918-f6719a02943b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:56.325488 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8c06e5fd-3d89-431d-9918-f6719a02943b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:56.326005 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8c06e5fd-3d89-431d-9918-f6719a02943b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:56.326963 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8c06e5fd-3d89-431d-9918-f6719a02943b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:56.327397 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8c06e5fd-3d89-431d-9918-f6719a02943b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:56.501149 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8c06e5fd-3d89-431d-9918-f6719a02943b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:56.510123 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-8c06e5fd-3d89-431d-9918-f6719a02943b tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.196513 Feb 21 04:18:56.519878 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 348/690] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:56 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:56.930613 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-c99cdf0b-3707-4fe6-9265-641b716d5c29 req-6ab0d772-99a2-45d8-8b35-7f28d7a8ff4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f1fe68-8efa-45ce-8c76-671456eca8ec", "name": "network-vif-deleted", "tag": "d27cb79f-b2f0-42e8-b1b6-081f71fbfcee"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:18:56.932230 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:18:56.932230 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:18:56.940433 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-c99cdf0b-3707-4fe6-9265-641b716d5c29 req-6ab0d772-99a2-45d8-8b35-7f28d7a8ff4f service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:56.940433 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-c99cdf0b-3707-4fe6-9265-641b716d5c29 req-6ab0d772-99a2-45d8-8b35-7f28d7a8ff4f service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:56.951296 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-c99cdf0b-3707-4fe6-9265-641b716d5c29 req-6ab0d772-99a2-45d8-8b35-7f28d7a8ff4f service nova] Creating event network-vif-deleted:d27cb79f-b2f0-42e8-b1b6-081f71fbfcee for instance c8f1fe68-8efa-45ce-8c76-671456eca8ec on hv-cinder-77398 Feb 21 04:18:56.956211 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-c99cdf0b-3707-4fe6-9265-641b716d5c29 req-6ab0d772-99a2-45d8-8b35-7f28d7a8ff4f service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029109 Feb 21 04:18:56.956778 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-18e912b4-20f5-4309-827f-0d45a97410cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:56.959166 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-18e912b4-20f5-4309-827f-0d45a97410cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:56.959573 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 343/691] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:18:56.974170 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-18e912b4-20f5-4309-827f-0d45a97410cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:56.974586 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-18e912b4-20f5-4309-827f-0d45a97410cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:56.975634 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-18e912b4-20f5-4309-827f-0d45a97410cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:56.977521 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-18e912b4-20f5-4309-827f-0d45a97410cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:57.066011 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-dfcd66d2-ad16-4e8e-903f-9394385c4232 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:57.066721 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-dfcd66d2-ad16-4e8e-903f-9394385c4232 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:57.074043 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dfcd66d2-ad16-4e8e-903f-9394385c4232 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:57.074488 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dfcd66d2-ad16-4e8e-903f-9394385c4232 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:57.075268 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dfcd66d2-ad16-4e8e-903f-9394385c4232 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:57.075700 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dfcd66d2-ad16-4e8e-903f-9394385c4232 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:57.121835 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dfcd66d2-ad16-4e8e-903f-9394385c4232 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:57.122281 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dfcd66d2-ad16-4e8e-903f-9394385c4232 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:57.122728 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-dfcd66d2-ad16-4e8e-903f-9394385c4232 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lazy-loading 'fault' on Instance uuid c8f1fe68-8efa-45ce-8c76-671456eca8ec {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:18:57.162526 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-18e912b4-20f5-4309-827f-0d45a97410cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:57.174901 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-18e912b4-20f5-4309-827f-0d45a97410cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:57.177765 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-18e912b4-20f5-4309-827f-0d45a97410cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:57.179006 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-18e912b4-20f5-4309-827f-0d45a97410cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1741 microversion: 2.20 time: 0.232851 Feb 21 04:18:57.179569 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 349/692] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:56 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1741 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:57.180868 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-dfcd66d2-ad16-4e8e-903f-9394385c4232 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:57.197138 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-dfcd66d2-ad16-4e8e-903f-9394385c4232 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 200 len: 1307 microversion: 2.1 time: 0.134572 Feb 21 04:18:57.197765 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 344/693] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:57 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 1307 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:57.526645 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-220c4d41-8389-45b5-bcb0-1df93e796206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:57.527253 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-220c4d41-8389-45b5-bcb0-1df93e796206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:57.533851 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-220c4d41-8389-45b5-bcb0-1df93e796206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:57.534301 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-220c4d41-8389-45b5-bcb0-1df93e796206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:57.535073 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-220c4d41-8389-45b5-bcb0-1df93e796206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:57.535505 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-220c4d41-8389-45b5-bcb0-1df93e796206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:57.680774 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-220c4d41-8389-45b5-bcb0-1df93e796206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:57.688817 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-220c4d41-8389-45b5-bcb0-1df93e796206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1313 microversion: 2.1 time: 0.165659 Feb 21 04:18:57.689881 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 350/694] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:57 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:58.197597 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-bcead92d-d618-4166-9502-37498c30da80 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:58.198287 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-bcead92d-d618-4166-9502-37498c30da80 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:58.205682 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bcead92d-d618-4166-9502-37498c30da80 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:58.206209 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bcead92d-d618-4166-9502-37498c30da80 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:58.207013 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bcead92d-d618-4166-9502-37498c30da80 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:58.207457 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bcead92d-d618-4166-9502-37498c30da80 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:58.214500 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-95b4573e-774c-4ee4-b7d9-eafd0c593849 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:58.215400 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-95b4573e-774c-4ee4-b7d9-eafd0c593849 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: c8f1fe68-8efa-45ce-8c76-671456eca8ec] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:58.221880 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-95b4573e-774c-4ee4-b7d9-eafd0c593849 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:58.222468 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-95b4573e-774c-4ee4-b7d9-eafd0c593849 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:58.223447 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-95b4573e-774c-4ee4-b7d9-eafd0c593849 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:58.224061 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-95b4573e-774c-4ee4-b7d9-eafd0c593849 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:58.239083 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-95b4573e-774c-4ee4-b7d9-eafd0c593849 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] HTTP exception thrown: Instance c8f1fe68-8efa-45ce-8c76-671456eca8ec could not be found. Feb 21 04:18:58.239673 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-95b4573e-774c-4ee4-b7d9-eafd0c593849 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Returning 404 to user: Instance c8f1fe68-8efa-45ce-8c76-671456eca8ec could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:18:58.240506 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-95b4573e-774c-4ee4-b7d9-eafd0c593849 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec" status: 404 len: 111 microversion: 2.1 time: 0.029724 Feb 21 04:18:58.241375 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 351/695] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:58 2022] GET /compute/v2.1/servers/c8f1fe68-8efa-45ce-8c76-671456eca8ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 04:18:58.485937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-bcead92d-d618-4166-9502-37498c30da80 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:58.494975 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-bcead92d-d618-4166-9502-37498c30da80 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:58.496700 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-bcead92d-d618-4166-9502-37498c30da80 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:58.498047 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-bcead92d-d618-4166-9502-37498c30da80 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1723 microversion: 2.20 time: 0.304323 Feb 21 04:18:58.498946 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 345/696] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:58 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:18:58.707541 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-91d123ae-d88e-4a96-b3cf-4168351c0d2f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:58.708289 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-91d123ae-d88e-4a96-b3cf-4168351c0d2f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:58.715277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-91d123ae-d88e-4a96-b3cf-4168351c0d2f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:58.716837 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-91d123ae-d88e-4a96-b3cf-4168351c0d2f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:58.718326 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-91d123ae-d88e-4a96-b3cf-4168351c0d2f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:58.719429 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-91d123ae-d88e-4a96-b3cf-4168351c0d2f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:58.914073 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-91d123ae-d88e-4a96-b3cf-4168351c0d2f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:58.921360 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-91d123ae-d88e-4a96-b3cf-4168351c0d2f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1497 microversion: 2.1 time: 0.218836 Feb 21 04:18:58.922111 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 352/697] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:58 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1497 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:18:59.412963 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-03908fcc-ceb0-444f-aa5e-abcf16291e4a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:59.413454 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-03908fcc-ceb0-444f-aa5e-abcf16291e4a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:59.423376 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03908fcc-ceb0-444f-aa5e-abcf16291e4a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:59.423877 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03908fcc-ceb0-444f-aa5e-abcf16291e4a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:59.424694 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03908fcc-ceb0-444f-aa5e-abcf16291e4a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:59.425129 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03908fcc-ceb0-444f-aa5e-abcf16291e4a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:59.460148 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-03908fcc-ceb0-444f-aa5e-abcf16291e4a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Going to try to terminate instance {{(pid=116570) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:18:59.516335 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-69603f0a-6f7f-4aae-b660-fb597e2e251d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:59.517043 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-69603f0a-6f7f-4aae-b660-fb597e2e251d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:59.524973 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-69603f0a-6f7f-4aae-b660-fb597e2e251d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:59.525547 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-69603f0a-6f7f-4aae-b660-fb597e2e251d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:59.526423 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-69603f0a-6f7f-4aae-b660-fb597e2e251d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:59.526957 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-69603f0a-6f7f-4aae-b660-fb597e2e251d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:59.623588 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-03908fcc-ceb0-444f-aa5e-abcf16291e4a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "DELETE /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 204 len: 0 microversion: 2.1 time: 0.213873 Feb 21 04:18:59.624110 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 346/698] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:18:59 2022] DELETE /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:18:59.642571 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-14f003a1-4d2a-4fc5-b7c9-99fda001382b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:18:59.643321 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-14f003a1-4d2a-4fc5-b7c9-99fda001382b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:18:59.659742 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-14f003a1-4d2a-4fc5-b7c9-99fda001382b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:59.660210 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-14f003a1-4d2a-4fc5-b7c9-99fda001382b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:59.660990 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-14f003a1-4d2a-4fc5-b7c9-99fda001382b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:18:59.661430 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-14f003a1-4d2a-4fc5-b7c9-99fda001382b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:18:59.744576 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-69603f0a-6f7f-4aae-b660-fb597e2e251d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:59.752820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-69603f0a-6f7f-4aae-b660-fb597e2e251d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:59.754531 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-69603f0a-6f7f-4aae-b660-fb597e2e251d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:59.755845 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-69603f0a-6f7f-4aae-b660-fb597e2e251d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1723 microversion: 2.20 time: 0.243197 Feb 21 04:18:59.757003 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 353/699] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:18:59 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:18:59.855102 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-14f003a1-4d2a-4fc5-b7c9-99fda001382b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:18:59.862573 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-14f003a1-4d2a-4fc5-b7c9-99fda001382b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1515 microversion: 2.1 time: 0.232516 Feb 21 04:18:59.863143 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 347/700] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:18:59 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:00.773320 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c3dd59e5-5a1e-46a4-8d41-e4fc5383cf10 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:00.774640 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c3dd59e5-5a1e-46a4-8d41-e4fc5383cf10 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:00.780507 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c3dd59e5-5a1e-46a4-8d41-e4fc5383cf10 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:00.780989 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c3dd59e5-5a1e-46a4-8d41-e4fc5383cf10 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:00.781763 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c3dd59e5-5a1e-46a4-8d41-e4fc5383cf10 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:00.782198 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c3dd59e5-5a1e-46a4-8d41-e4fc5383cf10 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:00.930007 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c3dd59e5-5a1e-46a4-8d41-e4fc5383cf10 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:00.938700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c3dd59e5-5a1e-46a4-8d41-e4fc5383cf10 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:00.940233 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c3dd59e5-5a1e-46a4-8d41-e4fc5383cf10 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:00.941417 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c3dd59e5-5a1e-46a4-8d41-e4fc5383cf10 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1723 microversion: 2.20 time: 0.171687 Feb 21 04:19:00.941965 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 354/701] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:00 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:01.055111 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4f4785ef-8ff6-4a0f-83df-c2eb629aa30b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:01.055727 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4f4785ef-8ff6-4a0f-83df-c2eb629aa30b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:01.061482 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4f4785ef-8ff6-4a0f-83df-c2eb629aa30b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:01.061933 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4f4785ef-8ff6-4a0f-83df-c2eb629aa30b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:01.062714 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4f4785ef-8ff6-4a0f-83df-c2eb629aa30b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:01.063149 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4f4785ef-8ff6-4a0f-83df-c2eb629aa30b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:01.193368 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4f4785ef-8ff6-4a0f-83df-c2eb629aa30b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:01.200539 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4f4785ef-8ff6-4a0f-83df-c2eb629aa30b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1515 microversion: 2.1 time: 0.325170 Feb 21 04:19:01.201135 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 348/702] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:00 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1515 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:01.683541 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-1252bd4e-22a6-42c8-84dc-42896400df4d req-a7c800b9-00d2-4ccb-a088-603235d91ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c59a20-ff75-456f-99b3-070207d951d7", "name": "network-vif-unplugged", "status": "completed", "tag": "ad4a893e-bbd1-41d8-a92a-483868402b5b"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:01.683541 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:19:01.683541 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:19:01.688264 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-1252bd4e-22a6-42c8-84dc-42896400df4d req-a7c800b9-00d2-4ccb-a088-603235d91ae0 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:01.688781 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-1252bd4e-22a6-42c8-84dc-42896400df4d req-a7c800b9-00d2-4ccb-a088-603235d91ae0 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:01.704474 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-1252bd4e-22a6-42c8-84dc-42896400df4d req-a7c800b9-00d2-4ccb-a088-603235d91ae0 service nova] Creating event network-vif-unplugged:ad4a893e-bbd1-41d8-a92a-483868402b5b for instance c0c59a20-ff75-456f-99b3-070207d951d7 on hv-cinder-77398 Feb 21 04:19:01.710170 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-1252bd4e-22a6-42c8-84dc-42896400df4d req-a7c800b9-00d2-4ccb-a088-603235d91ae0 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036488 Feb 21 04:19:01.710750 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 355/703] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:19:01.959597 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-40e54bc1-a32e-4b06-872a-6234c7bbb7d1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:01.960198 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-40e54bc1-a32e-4b06-872a-6234c7bbb7d1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:01.966433 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-40e54bc1-a32e-4b06-872a-6234c7bbb7d1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:01.966877 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-40e54bc1-a32e-4b06-872a-6234c7bbb7d1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:01.967643 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-40e54bc1-a32e-4b06-872a-6234c7bbb7d1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:01.968075 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-40e54bc1-a32e-4b06-872a-6234c7bbb7d1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:02.099050 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-40e54bc1-a32e-4b06-872a-6234c7bbb7d1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:02.106686 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-40e54bc1-a32e-4b06-872a-6234c7bbb7d1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:02.108169 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-40e54bc1-a32e-4b06-872a-6234c7bbb7d1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:02.109334 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-40e54bc1-a32e-4b06-872a-6234c7bbb7d1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1723 microversion: 2.20 time: 0.153471 Feb 21 04:19:02.109897 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 349/704] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:01 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:02.219013 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-82c0b6f0-0594-4993-8417-351d5f7ec86f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:02.219630 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-82c0b6f0-0594-4993-8417-351d5f7ec86f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:02.225847 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-82c0b6f0-0594-4993-8417-351d5f7ec86f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:02.226299 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-82c0b6f0-0594-4993-8417-351d5f7ec86f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:02.227074 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-82c0b6f0-0594-4993-8417-351d5f7ec86f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:02.227511 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-82c0b6f0-0594-4993-8417-351d5f7ec86f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:02.453319 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-82c0b6f0-0594-4993-8417-351d5f7ec86f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:02.461216 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-82c0b6f0-0594-4993-8417-351d5f7ec86f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1515 microversion: 2.1 time: 0.246830 Feb 21 04:19:02.461779 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 356/705] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:02 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1515 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:03.127725 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-81fff350-d3b6-4a39-b326-c672e3547f67 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:03.128267 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-81fff350-d3b6-4a39-b326-c672e3547f67 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:03.135692 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-81fff350-d3b6-4a39-b326-c672e3547f67 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:03.136138 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-81fff350-d3b6-4a39-b326-c672e3547f67 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:03.136950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-81fff350-d3b6-4a39-b326-c672e3547f67 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:03.137382 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-81fff350-d3b6-4a39-b326-c672e3547f67 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:03.270919 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-81fff350-d3b6-4a39-b326-c672e3547f67 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:03.278638 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-81fff350-d3b6-4a39-b326-c672e3547f67 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:03.280471 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-81fff350-d3b6-4a39-b326-c672e3547f67 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:03.281931 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-81fff350-d3b6-4a39-b326-c672e3547f67 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1723 microversion: 2.20 time: 0.158846 Feb 21 04:19:03.282503 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 350/706] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:03 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:03.477721 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-537987be-3644-4538-940f-6de104d7ccf0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:03.478329 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-537987be-3644-4538-940f-6de104d7ccf0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:03.484469 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-537987be-3644-4538-940f-6de104d7ccf0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:03.484953 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-537987be-3644-4538-940f-6de104d7ccf0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:03.485744 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-537987be-3644-4538-940f-6de104d7ccf0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:03.486202 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-537987be-3644-4538-940f-6de104d7ccf0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:03.621297 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-537987be-3644-4538-940f-6de104d7ccf0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:03.633296 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-537987be-3644-4538-940f-6de104d7ccf0 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1515 microversion: 2.1 time: 0.159137 Feb 21 04:19:03.633897 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 357/707] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:03 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:03.637097 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1b2174a1-e0e2-4a0d-81fe-3efadf8454fe tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:03.637593 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1b2174a1-e0e2-4a0d-81fe-3efadf8454fe tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:03.643874 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1b2174a1-e0e2-4a0d-81fe-3efadf8454fe tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:03.644331 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1b2174a1-e0e2-4a0d-81fe-3efadf8454fe tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:03.645109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1b2174a1-e0e2-4a0d-81fe-3efadf8454fe tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:03.645533 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1b2174a1-e0e2-4a0d-81fe-3efadf8454fe tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:03.670087 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1b2174a1-e0e2-4a0d-81fe-3efadf8454fe tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Going to try to terminate instance {{(pid=116570) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:19:03.748793 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1b2174a1-e0e2-4a0d-81fe-3efadf8454fe tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "DELETE /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 204 len: 0 microversion: 2.1 time: 0.114820 Feb 21 04:19:03.749678 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 351/708] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:19:03 2022] DELETE /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 04:19:03.758477 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e25c6d32-58cf-495f-9317-638e6f084bc1 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:03.759080 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e25c6d32-58cf-495f-9317-638e6f084bc1 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:03.766729 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e25c6d32-58cf-495f-9317-638e6f084bc1 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:03.767880 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e25c6d32-58cf-495f-9317-638e6f084bc1 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:03.768540 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e25c6d32-58cf-495f-9317-638e6f084bc1 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:03.768997 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e25c6d32-58cf-495f-9317-638e6f084bc1 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:03.863191 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1261909931", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "networks": [{"uuid": "6ccc7210-5287-4fb4-a169-f1209c8506d4"}]}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:03.904598 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e25c6d32-58cf-495f-9317-638e6f084bc1 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:03.912179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e25c6d32-58cf-495f-9317-638e6f084bc1 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1503 microversion: 2.1 time: 0.157361 Feb 21 04:19:03.912752 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 358/709] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:03 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:03.912860 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.network.neutron [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] validate_networks() for [('6ccc7210-5287-4fb4-a169-f1209c8506d4', None, None, None, None, None)] {{(pid=116570) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:19:04.244206 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Flavor limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:19:04.244819 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Image limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:19:04.245109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Flavor pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:19:04.245516 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Image pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:19:04.245924 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:19:04.255893 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:04.256325 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:04.257253 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:04.257911 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:04.274473 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Getting quotas for project f22350c00f594a80bdd31d6352b095e2. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:19:04.278585 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Getting quotas for user 17fe3cf35ac441e6b17bf8d52298f883 and project f22350c00f594a80bdd31d6352b095e2. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:19:04.290113 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Going to run 1 instances... {{(pid=116570) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:19:04.292533 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:19:04.300652 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-79c38b6d-fa29-426f-a049-a2aecb431d3c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:04.301342 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-79c38b6d-fa29-426f-a049-a2aecb431d3c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:04.307789 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79c38b6d-fa29-426f-a049-a2aecb431d3c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:04.308231 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79c38b6d-fa29-426f-a049-a2aecb431d3c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:04.309043 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79c38b6d-fa29-426f-a049-a2aecb431d3c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:04.309462 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79c38b6d-fa29-426f-a049-a2aecb431d3c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:04.338552 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d5886df1-ede9-4154-b553-25aea32461f7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.479279 Feb 21 04:19:04.339191 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 352/710] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:19:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:19:04.348950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f84bdc74-ed84-4c20-8c03-afc575b8e6b0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:04.349563 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f84bdc74-ed84-4c20-8c03-afc575b8e6b0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:04.482157 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f84bdc74-ed84-4c20-8c03-afc575b8e6b0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:04.492043 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f84bdc74-ed84-4c20-8c03-afc575b8e6b0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1219 microversion: 2.1 time: 0.147025 Feb 21 04:19:04.493410 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 353/711] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:04 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:04.503345 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-79c38b6d-fa29-426f-a049-a2aecb431d3c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:04.512960 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-79c38b6d-fa29-426f-a049-a2aecb431d3c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:04.515391 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-79c38b6d-fa29-426f-a049-a2aecb431d3c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:04.516787 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-79c38b6d-fa29-426f-a049-a2aecb431d3c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1723 microversion: 2.20 time: 0.220685 Feb 21 04:19:04.525250 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 359/712] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:04 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:19:04.649983 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7de1435d-25c4-4c25-a7eb-2275b1f4fcd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:04.650604 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7de1435d-25c4-4c25-a7eb-2275b1f4fcd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:04.656719 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7de1435d-25c4-4c25-a7eb-2275b1f4fcd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:04.657130 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7de1435d-25c4-4c25-a7eb-2275b1f4fcd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:04.658477 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7de1435d-25c4-4c25-a7eb-2275b1f4fcd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:04.658935 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7de1435d-25c4-4c25-a7eb-2275b1f4fcd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:04.805979 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7de1435d-25c4-4c25-a7eb-2275b1f4fcd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:04.813195 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7de1435d-25c4-4c25-a7eb-2275b1f4fcd9 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1515 microversion: 2.1 time: 0.166792 Feb 21 04:19:04.814223 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 354/713] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:04 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:04.891169 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-971691810", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:04.929385 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-36d0379c-d095-4a0e-9cff-af1b20713d38 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:04.930029 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-36d0379c-d095-4a0e-9cff-af1b20713d38 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:04.936061 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-36d0379c-d095-4a0e-9cff-af1b20713d38 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:04.936823 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-36d0379c-d095-4a0e-9cff-af1b20713d38 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:04.937689 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-36d0379c-d095-4a0e-9cff-af1b20713d38 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:04.938370 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-36d0379c-d095-4a0e-9cff-af1b20713d38 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:04.950483 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.network.neutron [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] validate_networks() for None {{(pid=116571) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:19:05.266583 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-36d0379c-d095-4a0e-9cff-af1b20713d38 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:05.274770 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-36d0379c-d095-4a0e-9cff-af1b20713d38 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1503 microversion: 2.1 time: 0.349463 Feb 21 04:19:05.275351 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 355/714] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:04 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1503 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:05.295481 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Flavor limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:19:05.295901 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Image limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:19:05.296379 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Flavor pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:19:05.296802 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Image pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:19:05.297237 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:19:05.306521 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:05.306962 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:05.307758 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:05.308184 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:05.324028 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Getting quotas for project a283a65347cb40d49115aa80e0927d0e. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:19:05.327845 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Getting quotas for user 288920ba584f4ec29101638e37e6f9c4 and project a283a65347cb40d49115aa80e0927d0e. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:19:05.338718 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Going to run 1 instances... {{(pid=116571) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:19:05.340947 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:19:05.383808 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-186e8cb2-71f7-4e09-9d8c-197d650b073a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496153 Feb 21 04:19:05.384447 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 360/715] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:19:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:19:05.394762 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4bf08b4b-a493-42ab-889c-67316ac78ea4 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:05.395596 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4bf08b4b-a493-42ab-889c-67316ac78ea4 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:05.452499 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4bf08b4b-a493-42ab-889c-67316ac78ea4 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:05.459320 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4bf08b4b-a493-42ab-889c-67316ac78ea4 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1214 microversion: 2.1 time: 0.068673 Feb 21 04:19:05.459887 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 356/716] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:05 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:05.509059 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f8e898dc-567a-45c1-b81f-57586b739a8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:05.509668 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f8e898dc-567a-45c1-b81f-57586b739a8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:05.516927 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f8e898dc-567a-45c1-b81f-57586b739a8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:05.517421 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f8e898dc-567a-45c1-b81f-57586b739a8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:05.518203 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f8e898dc-567a-45c1-b81f-57586b739a8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:05.518630 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f8e898dc-567a-45c1-b81f-57586b739a8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:05.534430 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8153e21e-4c46-438f-952d-5a72eb4e994e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:05.535036 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8153e21e-4c46-438f-952d-5a72eb4e994e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:05.552081 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8153e21e-4c46-438f-952d-5a72eb4e994e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:05.552529 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8153e21e-4c46-438f-952d-5a72eb4e994e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:05.553348 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8153e21e-4c46-438f-952d-5a72eb4e994e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:05.553779 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8153e21e-4c46-438f-952d-5a72eb4e994e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:05.588706 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-f8e898dc-567a-45c1-b81f-57586b739a8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:05.596455 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f8e898dc-567a-45c1-b81f-57586b739a8e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1271 microversion: 2.1 time: 0.090993 Feb 21 04:19:05.605995 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 361/717] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:05 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:05.773037 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8153e21e-4c46-438f-952d-5a72eb4e994e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:05.781516 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8153e21e-4c46-438f-952d-5a72eb4e994e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:05.789372 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8153e21e-4c46-438f-952d-5a72eb4e994e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:05.790671 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8153e21e-4c46-438f-952d-5a72eb4e994e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1726 microversion: 2.20 time: 0.259796 Feb 21 04:19:05.791305 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 357/718] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:05 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1726 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:05.810032 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0af8908c-04a4-4ea2-82a4-eec50de292cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "555a337d-36ca-4058-bf72-0989de17dfc0"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:05.811257 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0af8908c-04a4-4ea2-82a4-eec50de292cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:05.819840 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0af8908c-04a4-4ea2-82a4-eec50de292cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:05.820533 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0af8908c-04a4-4ea2-82a4-eec50de292cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:05.821636 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0af8908c-04a4-4ea2-82a4-eec50de292cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:05.822232 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0af8908c-04a4-4ea2-82a4-eec50de292cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:05.832445 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b42b26b7-43bf-4f53-8e99-2d272d9d4c83 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:05.833297 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b42b26b7-43bf-4f53-8e99-2d272d9d4c83 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:05.847733 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b42b26b7-43bf-4f53-8e99-2d272d9d4c83 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:05.848544 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b42b26b7-43bf-4f53-8e99-2d272d9d4c83 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:05.849860 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b42b26b7-43bf-4f53-8e99-2d272d9d4c83 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:05.853391 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b42b26b7-43bf-4f53-8e99-2d272d9d4c83 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:06.139788 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b42b26b7-43bf-4f53-8e99-2d272d9d4c83 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:06.148339 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b42b26b7-43bf-4f53-8e99-2d272d9d4c83 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1515 microversion: 2.1 time: 0.320668 Feb 21 04:19:06.149483 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 358/719] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:05 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1515 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:06.231439 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0af8908c-04a4-4ea2-82a4-eec50de292cf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "POST /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.425388 Feb 21 04:19:06.232059 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 362/720] 10.222.0.10 () {62 vars in 1363 bytes} [Mon Feb 21 04:19:05 2022] POST /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/os-volume_attachments => generated 188 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:19:06.296937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0fab501b-fe9e-49cc-955a-bad44d95de02 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:06.298161 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0fab501b-fe9e-49cc-955a-bad44d95de02 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:06.304964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0fab501b-fe9e-49cc-955a-bad44d95de02 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:06.306037 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0fab501b-fe9e-49cc-955a-bad44d95de02 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:06.306854 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0fab501b-fe9e-49cc-955a-bad44d95de02 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:06.307292 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0fab501b-fe9e-49cc-955a-bad44d95de02 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:06.366849 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f4f16e8c-d817-433a-b91c-c78b3c8ec197 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:06.367424 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f4f16e8c-d817-433a-b91c-c78b3c8ec197 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:06.376800 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f4f16e8c-d817-433a-b91c-c78b3c8ec197 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:06.378627 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f4f16e8c-d817-433a-b91c-c78b3c8ec197 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:06.379839 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f4f16e8c-d817-433a-b91c-c78b3c8ec197 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:06.380458 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f4f16e8c-d817-433a-b91c-c78b3c8ec197 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:06.665821 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f4f16e8c-d817-433a-b91c-c78b3c8ec197 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "POST /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/action" status: 202 len: 0 microversion: 2.20 time: 0.302523 Feb 21 04:19:06.667569 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 363/721] 10.222.0.10 () {62 vars in 1318 bytes} [Mon Feb 21 04:19:06 2022] POST /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:19:06.673690 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-56e92da0-7037-418a-b800-7cb6eadfc610 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:06.674312 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-56e92da0-7037-418a-b800-7cb6eadfc610 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:06.684855 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-56e92da0-7037-418a-b800-7cb6eadfc610 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:06.687178 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-56e92da0-7037-418a-b800-7cb6eadfc610 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:06.688645 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-56e92da0-7037-418a-b800-7cb6eadfc610 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:06.690854 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-56e92da0-7037-418a-b800-7cb6eadfc610 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:06.695768 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0fab501b-fe9e-49cc-955a-bad44d95de02 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:06.717224 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0fab501b-fe9e-49cc-955a-bad44d95de02 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1503 microversion: 2.1 time: 0.426639 Feb 21 04:19:06.721011 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 359/722] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:06 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1503 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:06.726250 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-edeb1426-70b9-43cc-8e49-2e6eca3ed80b req-0c8811ad-5a90-4089-8e74-f396d7e9c6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38295c86-79cf-4f53-828c-2f9e5350d0c8", "name": "network-vif-deleted", "tag": "202428dd-b415-43d4-9158-7c34074b9adf"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:06.745064 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:19:06.745064 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:19:06.786457 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-edeb1426-70b9-43cc-8e49-2e6eca3ed80b req-0c8811ad-5a90-4089-8e74-f396d7e9c6f4 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:06.787200 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-edeb1426-70b9-43cc-8e49-2e6eca3ed80b req-0c8811ad-5a90-4089-8e74-f396d7e9c6f4 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:06.815248 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-56e92da0-7037-418a-b800-7cb6eadfc610 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:06.824929 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-56e92da0-7037-418a-b800-7cb6eadfc610 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1284 microversion: 2.1 time: 0.155871 Feb 21 04:19:06.831870 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-edeb1426-70b9-43cc-8e49-2e6eca3ed80b req-0c8811ad-5a90-4089-8e74-f396d7e9c6f4 service nova] Creating event network-vif-deleted:202428dd-b415-43d4-9158-7c34074b9adf for instance 38295c86-79cf-4f53-828c-2f9e5350d0c8 on hv-cinder-77398 Feb 21 04:19:06.837651 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 364/723] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:06 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:06.842516 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-edeb1426-70b9-43cc-8e49-2e6eca3ed80b req-0c8811ad-5a90-4089-8e74-f396d7e9c6f4 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119576 Feb 21 04:19:06.842670 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ae330643-f643-4216-951e-b5a66e2a5669 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:06.843927 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ae330643-f643-4216-951e-b5a66e2a5669 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:06.846922 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 360/724] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:19:06.850901 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ae330643-f643-4216-951e-b5a66e2a5669 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:06.851352 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ae330643-f643-4216-951e-b5a66e2a5669 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:06.852216 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ae330643-f643-4216-951e-b5a66e2a5669 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:06.852685 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ae330643-f643-4216-951e-b5a66e2a5669 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:06.855955 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-05a25c40-608b-4849-98d2-c160f5256e99 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:06.860156 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-05a25c40-608b-4849-98d2-c160f5256e99 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:06.869808 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-05a25c40-608b-4849-98d2-c160f5256e99 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:06.875719 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-05a25c40-608b-4849-98d2-c160f5256e99 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:06.877116 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-05a25c40-608b-4849-98d2-c160f5256e99 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:06.879037 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-05a25c40-608b-4849-98d2-c160f5256e99 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:06.989985 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ae330643-f643-4216-951e-b5a66e2a5669 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:07.001083 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ae330643-f643-4216-951e-b5a66e2a5669 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1277 microversion: 2.1 time: 0.162218 Feb 21 04:19:07.002585 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 365/725] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:06 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:07.114198 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-05a25c40-608b-4849-98d2-c160f5256e99 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:07.125855 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-05a25c40-608b-4849-98d2-c160f5256e99 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:07.129822 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-05a25c40-608b-4849-98d2-c160f5256e99 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:07.131053 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-05a25c40-608b-4849-98d2-c160f5256e99 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1752 microversion: 2.20 time: 0.282979 Feb 21 04:19:07.141004 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 361/726] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:06 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1752 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:07.166478 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f05867f9-ef3b-4725-9b54-5c9fbb5bc3bf tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:07.167081 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f05867f9-ef3b-4725-9b54-5c9fbb5bc3bf tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:07.178583 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f05867f9-ef3b-4725-9b54-5c9fbb5bc3bf tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:07.180330 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f05867f9-ef3b-4725-9b54-5c9fbb5bc3bf tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:07.181347 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f05867f9-ef3b-4725-9b54-5c9fbb5bc3bf tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:07.182572 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f05867f9-ef3b-4725-9b54-5c9fbb5bc3bf tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:07.231147 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f05867f9-ef3b-4725-9b54-5c9fbb5bc3bf tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:07.231702 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f05867f9-ef3b-4725-9b54-5c9fbb5bc3bf tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:07.232900 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-f05867f9-ef3b-4725-9b54-5c9fbb5bc3bf tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lazy-loading 'fault' on Instance uuid 38295c86-79cf-4f53-828c-2f9e5350d0c8 {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:19:07.287729 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-f05867f9-ef3b-4725-9b54-5c9fbb5bc3bf tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:07.303467 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f05867f9-ef3b-4725-9b54-5c9fbb5bc3bf tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 200 len: 1308 microversion: 2.1 time: 0.140703 Feb 21 04:19:07.306045 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 366/727] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:07 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 1308 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:07.616834 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-c7276458-53ec-4274-9407-d6232eb2bd71 req-c30e088b-df53-42ee-88cb-3b94e2ebc873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce2584f-e283-4a21-9f5a-ff65156c3134", "name": "network-vif-deleted", "tag": "6a28ec8f-dde8-4a3b-a275-da59e9456f43"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:07.619873 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:19:07.619873 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:19:07.627303 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-c7276458-53ec-4274-9407-d6232eb2bd71 req-c30e088b-df53-42ee-88cb-3b94e2ebc873 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:07.628076 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-c7276458-53ec-4274-9407-d6232eb2bd71 req-c30e088b-df53-42ee-88cb-3b94e2ebc873 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:07.645667 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-c7276458-53ec-4274-9407-d6232eb2bd71 req-c30e088b-df53-42ee-88cb-3b94e2ebc873 service nova] Creating event network-vif-deleted:6a28ec8f-dde8-4a3b-a275-da59e9456f43 for instance 8ce2584f-e283-4a21-9f5a-ff65156c3134 on hv-cinder-77398 Feb 21 04:19:07.655430 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-c7276458-53ec-4274-9407-d6232eb2bd71 req-c30e088b-df53-42ee-88cb-3b94e2ebc873 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040530 Feb 21 04:19:07.655430 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 362/728] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:19:07.736166 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-98c205ca-a397-488e-bdf1-a42c79603206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:07.736834 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-98c205ca-a397-488e-bdf1-a42c79603206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:07.747668 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-98c205ca-a397-488e-bdf1-a42c79603206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:07.748117 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-98c205ca-a397-488e-bdf1-a42c79603206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:07.750565 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-98c205ca-a397-488e-bdf1-a42c79603206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:07.751015 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-98c205ca-a397-488e-bdf1-a42c79603206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:07.843972 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ac257e44-77bc-4a98-b725-5dbdec31f724 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:07.844825 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ac257e44-77bc-4a98-b725-5dbdec31f724 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:07.857442 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ac257e44-77bc-4a98-b725-5dbdec31f724 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:07.858373 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ac257e44-77bc-4a98-b725-5dbdec31f724 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:07.860959 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ac257e44-77bc-4a98-b725-5dbdec31f724 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:07.862032 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ac257e44-77bc-4a98-b725-5dbdec31f724 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:07.870894 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-98c205ca-a397-488e-bdf1-a42c79603206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d514193abb7427b82557293606d20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc69f57ebac4d74adf046561c782bbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:07.881423 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-98c205ca-a397-488e-bdf1-a42c79603206 tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 200 len: 1298 microversion: 2.1 time: 0.150006 Feb 21 04:19:07.882275 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 367/729] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:07 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:07.971673 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ac257e44-77bc-4a98-b725-5dbdec31f724 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:07.982274 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ac257e44-77bc-4a98-b725-5dbdec31f724 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1272 microversion: 2.1 time: 0.142778 Feb 21 04:19:07.989942 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 363/730] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:07 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:08.020136 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-effd7c5a-aa43-42f5-ab40-2a2fd4c40af8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:08.020519 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-effd7c5a-aa43-42f5-ab40-2a2fd4c40af8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:08.033587 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-effd7c5a-aa43-42f5-ab40-2a2fd4c40af8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:08.034033 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-effd7c5a-aa43-42f5-ab40-2a2fd4c40af8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:08.035380 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-effd7c5a-aa43-42f5-ab40-2a2fd4c40af8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:08.038357 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-effd7c5a-aa43-42f5-ab40-2a2fd4c40af8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:08.150851 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0bf36ab5-96aa-49ff-b142-705510f6b426 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:08.151538 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0bf36ab5-96aa-49ff-b142-705510f6b426 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:08.171485 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0bf36ab5-96aa-49ff-b142-705510f6b426 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:08.172238 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0bf36ab5-96aa-49ff-b142-705510f6b426 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:08.189915 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0bf36ab5-96aa-49ff-b142-705510f6b426 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:08.191146 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0bf36ab5-96aa-49ff-b142-705510f6b426 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:08.774202 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-effd7c5a-aa43-42f5-ab40-2a2fd4c40af8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:08.783540 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-effd7c5a-aa43-42f5-ab40-2a2fd4c40af8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.768680 Feb 21 04:19:08.784473 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 368/731] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:08 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:08.789386 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e4297f9c-f7da-4d8d-bd7e-71d36931184f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:08.790249 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e4297f9c-f7da-4d8d-bd7e-71d36931184f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 38295c86-79cf-4f53-828c-2f9e5350d0c8] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:08.799193 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e4297f9c-f7da-4d8d-bd7e-71d36931184f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:08.799795 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e4297f9c-f7da-4d8d-bd7e-71d36931184f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:08.800900 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e4297f9c-f7da-4d8d-bd7e-71d36931184f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:08.801637 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e4297f9c-f7da-4d8d-bd7e-71d36931184f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:08.816962 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-e4297f9c-f7da-4d8d-bd7e-71d36931184f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] HTTP exception thrown: Instance 38295c86-79cf-4f53-828c-2f9e5350d0c8 could not be found. Feb 21 04:19:08.817838 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e4297f9c-f7da-4d8d-bd7e-71d36931184f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Returning 404 to user: Instance 38295c86-79cf-4f53-828c-2f9e5350d0c8 could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:19:08.818767 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e4297f9c-f7da-4d8d-bd7e-71d36931184f tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8" status: 404 len: 111 microversion: 2.1 time: 0.033065 Feb 21 04:19:08.822411 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 369/732] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:08 2022] GET /compute/v2.1/servers/38295c86-79cf-4f53-828c-2f9e5350d0c8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:19:08.827061 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fc92abd9-a09f-4403-90af-eec5783cacc6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:08.827680 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fc92abd9-a09f-4403-90af-eec5783cacc6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:08.833552 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fc92abd9-a09f-4403-90af-eec5783cacc6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:08.834103 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fc92abd9-a09f-4403-90af-eec5783cacc6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:08.835066 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fc92abd9-a09f-4403-90af-eec5783cacc6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:08.835667 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fc92abd9-a09f-4403-90af-eec5783cacc6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:08.842686 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0bf36ab5-96aa-49ff-b142-705510f6b426 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:08.852949 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0bf36ab5-96aa-49ff-b142-705510f6b426 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:08.854879 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0bf36ab5-96aa-49ff-b142-705510f6b426 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:08.857798 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0bf36ab5-96aa-49ff-b142-705510f6b426 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1752 microversion: 2.20 time: 0.710226 Feb 21 04:19:08.858468 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 364/733] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:08 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1752 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:08.870421 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fc92abd9-a09f-4403-90af-eec5783cacc6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Going to try to terminate instance {{(pid=116571) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:19:08.899463 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d47e25cb-584f-428c-9d35-f3bcf6fae07f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:08.900082 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d47e25cb-584f-428c-9d35-f3bcf6fae07f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] [instance: 8ce2584f-e283-4a21-9f5a-ff65156c3134] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:08.915066 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d47e25cb-584f-428c-9d35-f3bcf6fae07f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:08.915567 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d47e25cb-584f-428c-9d35-f3bcf6fae07f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:08.916383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d47e25cb-584f-428c-9d35-f3bcf6fae07f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:08.916856 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d47e25cb-584f-428c-9d35-f3bcf6fae07f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:08.932830 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-d47e25cb-584f-428c-9d35-f3bcf6fae07f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] HTTP exception thrown: Instance 8ce2584f-e283-4a21-9f5a-ff65156c3134 could not be found. Feb 21 04:19:08.933680 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d47e25cb-584f-428c-9d35-f3bcf6fae07f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] Returning 404 to user: Instance 8ce2584f-e283-4a21-9f5a-ff65156c3134 could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:19:08.934713 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d47e25cb-584f-428c-9d35-f3bcf6fae07f tempest-VolumesActionsTest-44080586 tempest-VolumesActionsTest-44080586-project] 10.222.0.10 "GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134" status: 404 len: 111 microversion: 2.1 time: 0.039054 Feb 21 04:19:08.935572 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 365/734] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:08 2022] GET /compute/v2.1/servers/8ce2584f-e283-4a21-9f5a-ff65156c3134 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 04:19:09.004887 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-563fd01c-269b-4cc8-b69f-af80cadbffea tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:09.005701 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fc92abd9-a09f-4403-90af-eec5783cacc6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "DELETE /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 204 len: 0 microversion: 2.1 time: 0.180156 Feb 21 04:19:09.006307 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 370/735] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:19:08 2022] DELETE /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:19:09.006571 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-563fd01c-269b-4cc8-b69f-af80cadbffea tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:09.015733 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-28631447-9250-4746-b7c6-faf47c1d999c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:09.017335 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-28631447-9250-4746-b7c6-faf47c1d999c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:09.017995 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-563fd01c-269b-4cc8-b69f-af80cadbffea tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:09.018621 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-563fd01c-269b-4cc8-b69f-af80cadbffea tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:09.020204 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-563fd01c-269b-4cc8-b69f-af80cadbffea tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:09.021438 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-563fd01c-269b-4cc8-b69f-af80cadbffea tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:09.024926 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-28631447-9250-4746-b7c6-faf47c1d999c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:09.025430 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-28631447-9250-4746-b7c6-faf47c1d999c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:09.026222 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-28631447-9250-4746-b7c6-faf47c1d999c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:09.026801 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-28631447-9250-4746-b7c6-faf47c1d999c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:09.392501 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-563fd01c-269b-4cc8-b69f-af80cadbffea tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:09.398832 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-28631447-9250-4746-b7c6-faf47c1d999c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:09.405017 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-563fd01c-269b-4cc8-b69f-af80cadbffea tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.406832 Feb 21 04:19:09.406936 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-28631447-9250-4746-b7c6-faf47c1d999c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.396384 Feb 21 04:19:09.417701 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 371/736] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:09 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:09.417995 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 366/737] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:08 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:09.695204 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-f79fb9e4-c6dc-4174-ade2-f9ecbe8971ff req-5a123eca-d04f-42c9-8ed2-4abdd9e92e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6affb217-bc47-45c6-8219-a6b557defb55", "tag": "aa7d3525-7090-4e66-8272-2fa8eafeec4d"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:09.696012 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-efd509f4-8097-4190-a6f7-0aed4a6bf57c req-56ef6cfc-f902-458d-bb02-a59c947a2d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea586516-1575-4b69-b10e-b3f281b70c99", "tag": "717f4f68-10eb-467f-bfc7-a3b1a1bfc78f"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:09.697691 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:19:09.697691 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:19:09.698020 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:19:09.698020 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:19:09.710489 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-f79fb9e4-c6dc-4174-ade2-f9ecbe8971ff req-5a123eca-d04f-42c9-8ed2-4abdd9e92e1b service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:09.711267 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-f79fb9e4-c6dc-4174-ade2-f9ecbe8971ff req-5a123eca-d04f-42c9-8ed2-4abdd9e92e1b service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:09.725305 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-f79fb9e4-c6dc-4174-ade2-f9ecbe8971ff req-5a123eca-d04f-42c9-8ed2-4abdd9e92e1b service nova] Creating event network-changed:aa7d3525-7090-4e66-8272-2fa8eafeec4d for instance 6affb217-bc47-45c6-8219-a6b557defb55 on hv-cinder-77398 Feb 21 04:19:09.730722 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-efd509f4-8097-4190-a6f7-0aed4a6bf57c req-56ef6cfc-f902-458d-bb02-a59c947a2d94 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:09.731175 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-efd509f4-8097-4190-a6f7-0aed4a6bf57c req-56ef6cfc-f902-458d-bb02-a59c947a2d94 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:09.731286 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-f79fb9e4-c6dc-4174-ade2-f9ecbe8971ff req-5a123eca-d04f-42c9-8ed2-4abdd9e92e1b service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045319 Feb 21 04:19:09.731844 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 372/738] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:19:09.742900 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-efd509f4-8097-4190-a6f7-0aed4a6bf57c req-56ef6cfc-f902-458d-bb02-a59c947a2d94 service nova] Creating event network-changed:717f4f68-10eb-467f-bfc7-a3b1a1bfc78f for instance ea586516-1575-4b69-b10e-b3f281b70c99 on hv-cinder-77398 Feb 21 04:19:09.748134 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-efd509f4-8097-4190-a6f7-0aed4a6bf57c req-56ef6cfc-f902-458d-bb02-a59c947a2d94 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071867 Feb 21 04:19:09.752981 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 367/739] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:19:09.801445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e157c466-0752-460a-98bf-31785d68f4c9 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:09.802186 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e157c466-0752-460a-98bf-31785d68f4c9 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:09.818830 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e157c466-0752-460a-98bf-31785d68f4c9 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:09.819291 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e157c466-0752-460a-98bf-31785d68f4c9 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:09.820102 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e157c466-0752-460a-98bf-31785d68f4c9 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:09.825239 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e157c466-0752-460a-98bf-31785d68f4c9 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:09.878213 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-905a01cb-3bc0-45b1-8407-33f3a1e87d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:09.879622 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-905a01cb-3bc0-45b1-8407-33f3a1e87d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:09.893523 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-905a01cb-3bc0-45b1-8407-33f3a1e87d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:09.894246 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-905a01cb-3bc0-45b1-8407-33f3a1e87d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:09.895256 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-905a01cb-3bc0-45b1-8407-33f3a1e87d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:09.897053 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-905a01cb-3bc0-45b1-8407-33f3a1e87d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:10.218774 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e157c466-0752-460a-98bf-31785d68f4c9 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:10.223152 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-905a01cb-3bc0-45b1-8407-33f3a1e87d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:10.233360 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-905a01cb-3bc0-45b1-8407-33f3a1e87d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:10.235086 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-905a01cb-3bc0-45b1-8407-33f3a1e87d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:10.235519 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e157c466-0752-460a-98bf-31785d68f4c9 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.438368 Feb 21 04:19:10.237132 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-905a01cb-3bc0-45b1-8407-33f3a1e87d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.364089 Feb 21 04:19:10.237492 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 373/740] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:09 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:10.238043 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 368/741] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:09 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:19:10.425279 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-bc3dca47-a02c-4916-929b-0888e33b264f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:10.425491 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e3817d5b-038c-4e85-a253-cba7126a528c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:10.425890 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-bc3dca47-a02c-4916-929b-0888e33b264f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:10.426015 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e3817d5b-038c-4e85-a253-cba7126a528c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:10.431867 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bc3dca47-a02c-4916-929b-0888e33b264f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:10.432026 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e3817d5b-038c-4e85-a253-cba7126a528c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:10.432347 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bc3dca47-a02c-4916-929b-0888e33b264f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:10.432481 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e3817d5b-038c-4e85-a253-cba7126a528c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:10.433158 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bc3dca47-a02c-4916-929b-0888e33b264f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:10.433264 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e3817d5b-038c-4e85-a253-cba7126a528c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:10.433601 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bc3dca47-a02c-4916-929b-0888e33b264f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:10.433702 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e3817d5b-038c-4e85-a253-cba7126a528c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:10.628180 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-bc3dca47-a02c-4916-929b-0888e33b264f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:10.634847 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e3817d5b-038c-4e85-a253-cba7126a528c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:10.635612 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-bc3dca47-a02c-4916-929b-0888e33b264f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.214667 Feb 21 04:19:10.636232 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 374/742] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:10 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:10.642222 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e3817d5b-038c-4e85-a253-cba7126a528c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.220926 Feb 21 04:19:10.642935 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 369/743] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:10 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:11.253495 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-bb65dc54-932b-49b1-8255-bf490fcc0978 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:11.254209 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-bb65dc54-932b-49b1-8255-bf490fcc0978 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:11.255234 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0110353a-ec86-4fc8-941f-04366b10197c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:11.256211 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0110353a-ec86-4fc8-941f-04366b10197c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:11.260781 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bb65dc54-932b-49b1-8255-bf490fcc0978 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:11.261231 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bb65dc54-932b-49b1-8255-bf490fcc0978 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:11.261998 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bb65dc54-932b-49b1-8255-bf490fcc0978 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:11.262428 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bb65dc54-932b-49b1-8255-bf490fcc0978 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:11.262528 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0110353a-ec86-4fc8-941f-04366b10197c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:11.262955 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0110353a-ec86-4fc8-941f-04366b10197c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:11.263732 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0110353a-ec86-4fc8-941f-04366b10197c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:11.264478 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0110353a-ec86-4fc8-941f-04366b10197c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:11.458331 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-bb65dc54-932b-49b1-8255-bf490fcc0978 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:11.464964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0110353a-ec86-4fc8-941f-04366b10197c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:11.465755 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-bb65dc54-932b-49b1-8255-bf490fcc0978 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.216449 Feb 21 04:19:11.466392 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 375/744] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:11 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:11.473226 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0110353a-ec86-4fc8-941f-04366b10197c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:11.474718 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0110353a-ec86-4fc8-941f-04366b10197c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:11.475854 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0110353a-ec86-4fc8-941f-04366b10197c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.224761 Feb 21 04:19:11.476403 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 370/745] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:11 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:19:11.651978 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fbd40eaa-a11b-4839-9f97-b326a0b78e59 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:11.652590 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fbd40eaa-a11b-4839-9f97-b326a0b78e59 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:11.658497 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2059f4ab-9364-455f-96fc-3ebd223f3ba8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:11.658729 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fbd40eaa-a11b-4839-9f97-b326a0b78e59 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:11.659103 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2059f4ab-9364-455f-96fc-3ebd223f3ba8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:11.659215 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fbd40eaa-a11b-4839-9f97-b326a0b78e59 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:11.659917 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fbd40eaa-a11b-4839-9f97-b326a0b78e59 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:11.660349 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fbd40eaa-a11b-4839-9f97-b326a0b78e59 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:11.664980 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2059f4ab-9364-455f-96fc-3ebd223f3ba8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:11.665434 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2059f4ab-9364-455f-96fc-3ebd223f3ba8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:11.666198 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2059f4ab-9364-455f-96fc-3ebd223f3ba8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:11.666622 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2059f4ab-9364-455f-96fc-3ebd223f3ba8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:11.857193 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-fbd40eaa-a11b-4839-9f97-b326a0b78e59 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:11.861733 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2059f4ab-9364-455f-96fc-3ebd223f3ba8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:11.864942 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fbd40eaa-a11b-4839-9f97-b326a0b78e59 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.216497 Feb 21 04:19:11.865519 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 376/746] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:11 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:11.869261 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2059f4ab-9364-455f-96fc-3ebd223f3ba8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.214185 Feb 21 04:19:11.869928 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 371/747] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:11 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:12.482127 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c3736e7b-3991-4073-8f8a-d0ce1eb95597 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:12.482736 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c3736e7b-3991-4073-8f8a-d0ce1eb95597 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:12.489049 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c3736e7b-3991-4073-8f8a-d0ce1eb95597 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:12.489503 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c3736e7b-3991-4073-8f8a-d0ce1eb95597 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:12.490283 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c3736e7b-3991-4073-8f8a-d0ce1eb95597 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:12.490721 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c3736e7b-3991-4073-8f8a-d0ce1eb95597 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:12.493710 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b1a399b0-6e00-4075-8196-dedf079c53fb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:12.494307 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b1a399b0-6e00-4075-8196-dedf079c53fb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:12.500345 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b1a399b0-6e00-4075-8196-dedf079c53fb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:12.500832 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b1a399b0-6e00-4075-8196-dedf079c53fb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:12.501595 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b1a399b0-6e00-4075-8196-dedf079c53fb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:12.502025 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b1a399b0-6e00-4075-8196-dedf079c53fb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:12.686535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c3736e7b-3991-4073-8f8a-d0ce1eb95597 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:12.691019 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b1a399b0-6e00-4075-8196-dedf079c53fb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:12.694275 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c3736e7b-3991-4073-8f8a-d0ce1eb95597 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.215755 Feb 21 04:19:12.694840 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 377/748] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:12 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:12.699074 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b1a399b0-6e00-4075-8196-dedf079c53fb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:12.700579 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b1a399b0-6e00-4075-8196-dedf079c53fb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:12.701744 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b1a399b0-6e00-4075-8196-dedf079c53fb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.211725 Feb 21 04:19:12.702288 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 372/749] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:12 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:19:12.881879 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-78b7b8f6-1f2b-4e48-974f-0863800517ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:12.882478 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-78b7b8f6-1f2b-4e48-974f-0863800517ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:12.885434 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5c224765-8473-4db5-9eac-c2dac7b824f6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:12.886045 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5c224765-8473-4db5-9eac-c2dac7b824f6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:12.888280 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78b7b8f6-1f2b-4e48-974f-0863800517ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:12.888752 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78b7b8f6-1f2b-4e48-974f-0863800517ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:12.889521 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78b7b8f6-1f2b-4e48-974f-0863800517ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:12.889953 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78b7b8f6-1f2b-4e48-974f-0863800517ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:12.891857 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c224765-8473-4db5-9eac-c2dac7b824f6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:12.892998 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c224765-8473-4db5-9eac-c2dac7b824f6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:12.893778 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c224765-8473-4db5-9eac-c2dac7b824f6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:12.894211 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c224765-8473-4db5-9eac-c2dac7b824f6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:13.152017 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-78b7b8f6-1f2b-4e48-974f-0863800517ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:13.160901 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-78b7b8f6-1f2b-4e48-974f-0863800517ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.282517 Feb 21 04:19:13.161667 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 378/750] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:12 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:13.165592 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5c224765-8473-4db5-9eac-c2dac7b824f6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:13.176900 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5c224765-8473-4db5-9eac-c2dac7b824f6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.294539 Feb 21 04:19:13.186173 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 373/751] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:12 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:13.710953 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-99b42250-e05a-4d12-896d-9af64f267803 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:13.711567 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-99b42250-e05a-4d12-896d-9af64f267803 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:13.717871 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-99b42250-e05a-4d12-896d-9af64f267803 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:13.718319 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-99b42250-e05a-4d12-896d-9af64f267803 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:13.718792 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-63b21395-e73a-4eea-bc6a-d2fe3e3c074d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:13.719243 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-99b42250-e05a-4d12-896d-9af64f267803 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:13.719392 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-63b21395-e73a-4eea-bc6a-d2fe3e3c074d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:13.719496 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-99b42250-e05a-4d12-896d-9af64f267803 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:13.726337 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-63b21395-e73a-4eea-bc6a-d2fe3e3c074d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:13.726777 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-63b21395-e73a-4eea-bc6a-d2fe3e3c074d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:13.727547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-63b21395-e73a-4eea-bc6a-d2fe3e3c074d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:13.727970 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-63b21395-e73a-4eea-bc6a-d2fe3e3c074d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:13.918280 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-99b42250-e05a-4d12-896d-9af64f267803 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:13.921584 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-63b21395-e73a-4eea-bc6a-d2fe3e3c074d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:13.925425 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-99b42250-e05a-4d12-896d-9af64f267803 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.218049 Feb 21 04:19:13.925990 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 379/752] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:13 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:13.930214 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-63b21395-e73a-4eea-bc6a-d2fe3e3c074d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:13.931919 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-63b21395-e73a-4eea-bc6a-d2fe3e3c074d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:13.933110 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-63b21395-e73a-4eea-bc6a-d2fe3e3c074d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.217894 Feb 21 04:19:13.933661 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 374/753] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:13 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:19:14.177537 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-46d36639-9f6c-46cb-85e5-95c6fd60e144 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:14.178085 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-46d36639-9f6c-46cb-85e5-95c6fd60e144 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:14.183948 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-46d36639-9f6c-46cb-85e5-95c6fd60e144 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:14.184403 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-46d36639-9f6c-46cb-85e5-95c6fd60e144 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:14.185222 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-46d36639-9f6c-46cb-85e5-95c6fd60e144 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:14.185663 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-46d36639-9f6c-46cb-85e5-95c6fd60e144 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:14.193850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-bb165692-a62c-4346-bc75-3020a050fbeb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:14.194456 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-bb165692-a62c-4346-bc75-3020a050fbeb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:14.200114 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bb165692-a62c-4346-bc75-3020a050fbeb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:14.200552 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bb165692-a62c-4346-bc75-3020a050fbeb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:14.201360 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bb165692-a62c-4346-bc75-3020a050fbeb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:14.201786 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bb165692-a62c-4346-bc75-3020a050fbeb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:14.388065 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-46d36639-9f6c-46cb-85e5-95c6fd60e144 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:14.393460 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-bb165692-a62c-4346-bc75-3020a050fbeb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:14.396897 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-46d36639-9f6c-46cb-85e5-95c6fd60e144 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.222980 Feb 21 04:19:14.397475 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 380/754] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:14 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:14.400840 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-bb165692-a62c-4346-bc75-3020a050fbeb tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.210546 Feb 21 04:19:14.401525 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 375/755] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:14 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:14.941824 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-559f24a7-ec03-42b2-9b2d-1b4aafd9fa31 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:14.942449 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-559f24a7-ec03-42b2-9b2d-1b4aafd9fa31 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:14.949070 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-559f24a7-ec03-42b2-9b2d-1b4aafd9fa31 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:14.949580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-559f24a7-ec03-42b2-9b2d-1b4aafd9fa31 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:14.950375 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-559f24a7-ec03-42b2-9b2d-1b4aafd9fa31 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:14.950819 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-559f24a7-ec03-42b2-9b2d-1b4aafd9fa31 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:14.951212 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ad6f2496-154b-4ade-a67e-cd46490219bf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:14.951816 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ad6f2496-154b-4ade-a67e-cd46490219bf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:14.958795 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ad6f2496-154b-4ade-a67e-cd46490219bf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:14.959238 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ad6f2496-154b-4ade-a67e-cd46490219bf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:14.960006 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ad6f2496-154b-4ade-a67e-cd46490219bf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:14.960437 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ad6f2496-154b-4ade-a67e-cd46490219bf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:15.250250 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-559f24a7-ec03-42b2-9b2d-1b4aafd9fa31 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:15.257517 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-559f24a7-ec03-42b2-9b2d-1b4aafd9fa31 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.319355 Feb 21 04:19:15.258282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 381/756] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:14 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:15.259019 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ad6f2496-154b-4ade-a67e-cd46490219bf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:15.268967 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ad6f2496-154b-4ade-a67e-cd46490219bf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:15.270476 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ad6f2496-154b-4ade-a67e-cd46490219bf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:15.271654 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ad6f2496-154b-4ade-a67e-cd46490219bf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.324147 Feb 21 04:19:15.272201 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 376/757] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:14 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:15.414670 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-807916d4-35fd-47c9-ba12-e3b1614f290b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:15.415280 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-807916d4-35fd-47c9-ba12-e3b1614f290b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:15.417608 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-dc4273aa-2eee-40fb-811e-18503468ea70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:15.418217 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-dc4273aa-2eee-40fb-811e-18503468ea70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:15.421015 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-807916d4-35fd-47c9-ba12-e3b1614f290b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:15.421466 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-807916d4-35fd-47c9-ba12-e3b1614f290b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:15.422294 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-807916d4-35fd-47c9-ba12-e3b1614f290b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:15.422728 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-807916d4-35fd-47c9-ba12-e3b1614f290b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:15.424343 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc4273aa-2eee-40fb-811e-18503468ea70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:15.425028 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc4273aa-2eee-40fb-811e-18503468ea70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:15.425968 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc4273aa-2eee-40fb-811e-18503468ea70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:15.426396 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dc4273aa-2eee-40fb-811e-18503468ea70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:15.624404 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-807916d4-35fd-47c9-ba12-e3b1614f290b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:15.628422 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-dc4273aa-2eee-40fb-811e-18503468ea70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:15.632211 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-807916d4-35fd-47c9-ba12-e3b1614f290b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.221455 Feb 21 04:19:15.632900 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 382/758] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:15 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:15.637007 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-dc4273aa-2eee-40fb-811e-18503468ea70 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.222858 Feb 21 04:19:15.640680 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 377/759] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:15 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:16.275607 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-16174782-bc85-4803-93ea-84e89612bfd6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:16.276875 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-16174782-bc85-4803-93ea-84e89612bfd6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:16.284588 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-16174782-bc85-4803-93ea-84e89612bfd6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:16.285314 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-16174782-bc85-4803-93ea-84e89612bfd6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:16.290863 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-669ac91e-bd85-4830-96d0-e45d20622ed2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:16.292034 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-669ac91e-bd85-4830-96d0-e45d20622ed2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:16.300135 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-16174782-bc85-4803-93ea-84e89612bfd6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:16.300569 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-16174782-bc85-4803-93ea-84e89612bfd6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:16.305384 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-669ac91e-bd85-4830-96d0-e45d20622ed2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:16.305935 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-669ac91e-bd85-4830-96d0-e45d20622ed2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:16.306893 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-669ac91e-bd85-4830-96d0-e45d20622ed2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:16.307342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-669ac91e-bd85-4830-96d0-e45d20622ed2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:16.526744 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-669ac91e-bd85-4830-96d0-e45d20622ed2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:16.540229 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-669ac91e-bd85-4830-96d0-e45d20622ed2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:16.550528 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-669ac91e-bd85-4830-96d0-e45d20622ed2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:16.551866 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-669ac91e-bd85-4830-96d0-e45d20622ed2 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.264858 Feb 21 04:19:16.552713 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 378/760] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:16 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:16.617540 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-16174782-bc85-4803-93ea-84e89612bfd6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:16.625636 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-16174782-bc85-4803-93ea-84e89612bfd6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.354420 Feb 21 04:19:16.631823 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 383/761] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:16 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:16.649904 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a07926ef-b8e7-4ab6-afd2-ade65300a99b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:16.650510 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a07926ef-b8e7-4ab6-afd2-ade65300a99b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:16.656410 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-919cf290-c7f8-40a0-a731-c5fc15f73004 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:16.657240 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-919cf290-c7f8-40a0-a731-c5fc15f73004 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:16.664977 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a07926ef-b8e7-4ab6-afd2-ade65300a99b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:16.665508 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a07926ef-b8e7-4ab6-afd2-ade65300a99b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:16.666292 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a07926ef-b8e7-4ab6-afd2-ade65300a99b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:16.666751 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a07926ef-b8e7-4ab6-afd2-ade65300a99b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:16.669014 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-919cf290-c7f8-40a0-a731-c5fc15f73004 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:16.669795 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-919cf290-c7f8-40a0-a731-c5fc15f73004 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:16.670956 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-919cf290-c7f8-40a0-a731-c5fc15f73004 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:16.671499 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-919cf290-c7f8-40a0-a731-c5fc15f73004 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:16.925118 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a07926ef-b8e7-4ab6-afd2-ade65300a99b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:16.943851 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a07926ef-b8e7-4ab6-afd2-ade65300a99b tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.298268 Feb 21 04:19:16.957230 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 379/762] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:16 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:17.023415 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-919cf290-c7f8-40a0-a731-c5fc15f73004 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:17.036613 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-919cf290-c7f8-40a0-a731-c5fc15f73004 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.383628 Feb 21 04:19:17.041272 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 384/763] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:16 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:17.569829 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b18aa5c2-060d-4480-80b4-04cbdfce223f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:17.571457 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b18aa5c2-060d-4480-80b4-04cbdfce223f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:17.578333 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b18aa5c2-060d-4480-80b4-04cbdfce223f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:17.579665 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b18aa5c2-060d-4480-80b4-04cbdfce223f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:17.580724 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b18aa5c2-060d-4480-80b4-04cbdfce223f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:17.581375 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b18aa5c2-060d-4480-80b4-04cbdfce223f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:17.644025 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-97fdf12a-5b59-4ea3-a877-1bca8377500e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:17.645534 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-97fdf12a-5b59-4ea3-a877-1bca8377500e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:17.663309 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-97fdf12a-5b59-4ea3-a877-1bca8377500e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:17.668554 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-97fdf12a-5b59-4ea3-a877-1bca8377500e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:17.671478 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-97fdf12a-5b59-4ea3-a877-1bca8377500e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:17.674038 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-97fdf12a-5b59-4ea3-a877-1bca8377500e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:17.891365 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b18aa5c2-060d-4480-80b4-04cbdfce223f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:17.901182 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b18aa5c2-060d-4480-80b4-04cbdfce223f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:17.908352 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b18aa5c2-060d-4480-80b4-04cbdfce223f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:17.911172 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b18aa5c2-060d-4480-80b4-04cbdfce223f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.344984 Feb 21 04:19:17.913861 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 380/764] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:17 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:17.963070 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-309910fe-0dc9-44ce-9cc1-cc5234104c0c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:17.964401 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-309910fe-0dc9-44ce-9cc1-cc5234104c0c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:17.974521 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-97fdf12a-5b59-4ea3-a877-1bca8377500e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:17.983007 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-309910fe-0dc9-44ce-9cc1-cc5234104c0c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:17.983242 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-97fdf12a-5b59-4ea3-a877-1bca8377500e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.343522 Feb 21 04:19:17.984909 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 385/765] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:17 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:17.989723 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-309910fe-0dc9-44ce-9cc1-cc5234104c0c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:17.991526 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-309910fe-0dc9-44ce-9cc1-cc5234104c0c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:17.992186 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-309910fe-0dc9-44ce-9cc1-cc5234104c0c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:18.059642 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7e16f4d0-731a-46ee-abac-30023c884d84 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:18.061192 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7e16f4d0-731a-46ee-abac-30023c884d84 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:18.079978 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7e16f4d0-731a-46ee-abac-30023c884d84 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:18.091341 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7e16f4d0-731a-46ee-abac-30023c884d84 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:18.092484 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7e16f4d0-731a-46ee-abac-30023c884d84 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:18.093103 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7e16f4d0-731a-46ee-abac-30023c884d84 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:18.271049 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-309910fe-0dc9-44ce-9cc1-cc5234104c0c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:18.281912 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-309910fe-0dc9-44ce-9cc1-cc5234104c0c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.321014 Feb 21 04:19:18.297060 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 381/766] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:17 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:18.366794 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7e16f4d0-731a-46ee-abac-30023c884d84 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:18.378609 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7e16f4d0-731a-46ee-abac-30023c884d84 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.324108 Feb 21 04:19:18.381255 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 386/767] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:18 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:18.608079 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:19:18.608613 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: Mon Feb 21 04:19:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:19:19.002871 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ec2735c3-5722-454d-9ee4-dfb72b280d5e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:19.005080 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ec2735c3-5722-454d-9ee4-dfb72b280d5e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:19.015457 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ec2735c3-5722-454d-9ee4-dfb72b280d5e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:19.016270 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ec2735c3-5722-454d-9ee4-dfb72b280d5e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:19.017872 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ec2735c3-5722-454d-9ee4-dfb72b280d5e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:19.018518 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ec2735c3-5722-454d-9ee4-dfb72b280d5e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:19.227467 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ec2735c3-5722-454d-9ee4-dfb72b280d5e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:19.256877 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ec2735c3-5722-454d-9ee4-dfb72b280d5e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.258854 Feb 21 04:19:19.260945 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 387/768] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:18 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:19.290099 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8170f7eb-8308-4a24-a0b1-8c74fe350a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:19.291369 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8170f7eb-8308-4a24-a0b1-8c74fe350a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:19.299193 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8170f7eb-8308-4a24-a0b1-8c74fe350a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:19.300357 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-54969cea-46a1-4b87-a4ab-b7ae35dadb64 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:19.301109 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-54969cea-46a1-4b87-a4ab-b7ae35dadb64 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:19.303079 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8170f7eb-8308-4a24-a0b1-8c74fe350a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:19.304067 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8170f7eb-8308-4a24-a0b1-8c74fe350a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:19.307640 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8170f7eb-8308-4a24-a0b1-8c74fe350a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:19.310081 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-54969cea-46a1-4b87-a4ab-b7ae35dadb64 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:19.312891 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-54969cea-46a1-4b87-a4ab-b7ae35dadb64 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:19.314456 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-54969cea-46a1-4b87-a4ab-b7ae35dadb64 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:19.316125 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-54969cea-46a1-4b87-a4ab-b7ae35dadb64 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:19.633950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8170f7eb-8308-4a24-a0b1-8c74fe350a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:19.637646 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-54969cea-46a1-4b87-a4ab-b7ae35dadb64 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:19.645783 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-54969cea-46a1-4b87-a4ab-b7ae35dadb64 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.350335 Feb 21 04:19:19.651084 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8170f7eb-8308-4a24-a0b1-8c74fe350a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:19.653173 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8170f7eb-8308-4a24-a0b1-8c74fe350a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:19.654482 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8170f7eb-8308-4a24-a0b1-8c74fe350a8d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.722341 Feb 21 04:19:19.655154 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 382/769] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:18 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:19.656130 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 388/770] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:19 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:19.664058 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-51dba881-f65e-4dc4-b4a4-bd75c331d082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:19.668864 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-f2298e4e-4f2f-4c58-bd37-10e78c238159 req-e55c1876-eeed-41d4-b171-53dcc2beb891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a128817-df9b-46f1-902b-03d1cbcddb7d", "name": "network-vif-unplugged", "status": "completed", "tag": "ad59d774-1de8-45e3-a9d1-6d9c1aeca36e"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:19.670297 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:19:19.670297 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:19:19.671028 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-51dba881-f65e-4dc4-b4a4-bd75c331d082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:19.683158 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-51dba881-f65e-4dc4-b4a4-bd75c331d082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:19.686837 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-f2298e4e-4f2f-4c58-bd37-10e78c238159 req-e55c1876-eeed-41d4-b171-53dcc2beb891 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:19.686837 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-f2298e4e-4f2f-4c58-bd37-10e78c238159 req-e55c1876-eeed-41d4-b171-53dcc2beb891 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:19.687101 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-51dba881-f65e-4dc4-b4a4-bd75c331d082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:19.687688 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-51dba881-f65e-4dc4-b4a4-bd75c331d082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:19.688241 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-51dba881-f65e-4dc4-b4a4-bd75c331d082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:19.715291 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-f2298e4e-4f2f-4c58-bd37-10e78c238159 req-e55c1876-eeed-41d4-b171-53dcc2beb891 service nova] Creating event network-vif-unplugged:ad59d774-1de8-45e3-a9d1-6d9c1aeca36e for instance 4a128817-df9b-46f1-902b-03d1cbcddb7d on hv-cinder-77398 Feb 21 04:19:19.726349 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-f2298e4e-4f2f-4c58-bd37-10e78c238159 req-e55c1876-eeed-41d4-b171-53dcc2beb891 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068859 Feb 21 04:19:19.727343 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 389/771] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:19:19.878849 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-51dba881-f65e-4dc4-b4a4-bd75c331d082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:19.889970 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-51dba881-f65e-4dc4-b4a4-bd75c331d082 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.229308 Feb 21 04:19:19.890785 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 383/772] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:19 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:20.276140 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3b1d2143-f5d8-4c93-a071-8ab5ce2de8b8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:20.276844 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3b1d2143-f5d8-4c93-a071-8ab5ce2de8b8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:20.287867 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3b1d2143-f5d8-4c93-a071-8ab5ce2de8b8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:20.291403 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3b1d2143-f5d8-4c93-a071-8ab5ce2de8b8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:20.298938 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3b1d2143-f5d8-4c93-a071-8ab5ce2de8b8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:20.299535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3b1d2143-f5d8-4c93-a071-8ab5ce2de8b8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:20.500406 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-3b1d2143-f5d8-4c93-a071-8ab5ce2de8b8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:20.511416 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3b1d2143-f5d8-4c93-a071-8ab5ce2de8b8 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.237861 Feb 21 04:19:20.513244 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 390/773] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:20 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:20.679822 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7567bbd1-03cb-4c66-ba56-85f081fc25ad tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:20.684024 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9e619122-5ad6-4f65-be2c-8789e7b8be50 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:20.685574 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9e619122-5ad6-4f65-be2c-8789e7b8be50 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:20.693913 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7567bbd1-03cb-4c66-ba56-85f081fc25ad tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:20.709100 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9e619122-5ad6-4f65-be2c-8789e7b8be50 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:20.709573 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9e619122-5ad6-4f65-be2c-8789e7b8be50 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:20.710515 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9e619122-5ad6-4f65-be2c-8789e7b8be50 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:20.710895 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9e619122-5ad6-4f65-be2c-8789e7b8be50 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:20.716359 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7567bbd1-03cb-4c66-ba56-85f081fc25ad tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:20.719066 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7567bbd1-03cb-4c66-ba56-85f081fc25ad tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:20.720113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7567bbd1-03cb-4c66-ba56-85f081fc25ad tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:20.720625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7567bbd1-03cb-4c66-ba56-85f081fc25ad tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:21.191675 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9e619122-5ad6-4f65-be2c-8789e7b8be50 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:21.203479 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9e619122-5ad6-4f65-be2c-8789e7b8be50 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.543524 Feb 21 04:19:21.208027 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 384/774] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:20 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:21.219667 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f6c2ac0a-9632-4b52-9411-627604e1af5c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:21.220906 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f6c2ac0a-9632-4b52-9411-627604e1af5c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:21.228583 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f6c2ac0a-9632-4b52-9411-627604e1af5c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:21.229378 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f6c2ac0a-9632-4b52-9411-627604e1af5c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:21.230947 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f6c2ac0a-9632-4b52-9411-627604e1af5c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:21.231880 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f6c2ac0a-9632-4b52-9411-627604e1af5c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:21.275662 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7567bbd1-03cb-4c66-ba56-85f081fc25ad tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:21.287310 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7567bbd1-03cb-4c66-ba56-85f081fc25ad tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:21.289349 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7567bbd1-03cb-4c66-ba56-85f081fc25ad tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:21.290666 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7567bbd1-03cb-4c66-ba56-85f081fc25ad tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.616039 Feb 21 04:19:21.302427 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 391/775] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:20 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:19:21.428586 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f6c2ac0a-9632-4b52-9411-627604e1af5c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:21.438332 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f6c2ac0a-9632-4b52-9411-627604e1af5c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.228712 Feb 21 04:19:21.448702 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 385/776] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:21 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:21.538697 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d22a653c-7ebc-4d1b-8384-48a5ebfb862a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:21.539559 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d22a653c-7ebc-4d1b-8384-48a5ebfb862a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:21.550563 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d22a653c-7ebc-4d1b-8384-48a5ebfb862a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:21.551122 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d22a653c-7ebc-4d1b-8384-48a5ebfb862a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:21.565074 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d22a653c-7ebc-4d1b-8384-48a5ebfb862a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:21.565724 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d22a653c-7ebc-4d1b-8384-48a5ebfb862a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:21.814283 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d22a653c-7ebc-4d1b-8384-48a5ebfb862a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:21.824318 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d22a653c-7ebc-4d1b-8384-48a5ebfb862a tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.289457 Feb 21 04:19:21.835475 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 392/777] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:21 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:22.222157 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-94360352-5e95-4b7d-8d81-c82ad8c205e8 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:22.223480 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-94360352-5e95-4b7d-8d81-c82ad8c205e8 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:22.230637 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-94360352-5e95-4b7d-8d81-c82ad8c205e8 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:22.231280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-94360352-5e95-4b7d-8d81-c82ad8c205e8 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:22.232231 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-94360352-5e95-4b7d-8d81-c82ad8c205e8 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:22.232842 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-94360352-5e95-4b7d-8d81-c82ad8c205e8 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:22.309474 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7ceb37fc-ed53-4b57-afa9-931c68f8140b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:22.310632 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7ceb37fc-ed53-4b57-afa9-931c68f8140b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:22.323878 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ceb37fc-ed53-4b57-afa9-931c68f8140b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:22.324537 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ceb37fc-ed53-4b57-afa9-931c68f8140b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:22.325583 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ceb37fc-ed53-4b57-afa9-931c68f8140b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:22.326171 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ceb37fc-ed53-4b57-afa9-931c68f8140b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:22.527784 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-94360352-5e95-4b7d-8d81-c82ad8c205e8 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:22.541076 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-94360352-5e95-4b7d-8d81-c82ad8c205e8 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.321893 Feb 21 04:19:22.553090 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 386/778] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:22 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:22.558315 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-12b32cab-093b-4654-ad0d-b7588f6cee39 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:22.559142 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-12b32cab-093b-4654-ad0d-b7588f6cee39 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:22.573541 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-12b32cab-093b-4654-ad0d-b7588f6cee39 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:22.573994 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-12b32cab-093b-4654-ad0d-b7588f6cee39 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:22.575661 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-12b32cab-093b-4654-ad0d-b7588f6cee39 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:22.576100 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-12b32cab-093b-4654-ad0d-b7588f6cee39 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:22.692102 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7ceb37fc-ed53-4b57-afa9-931c68f8140b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:22.703833 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7ceb37fc-ed53-4b57-afa9-931c68f8140b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:22.706056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7ceb37fc-ed53-4b57-afa9-931c68f8140b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:22.707250 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7ceb37fc-ed53-4b57-afa9-931c68f8140b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.402076 Feb 21 04:19:22.717908 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 393/779] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:22 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:19:22.783911 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-12b32cab-093b-4654-ad0d-b7588f6cee39 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:22.792231 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-12b32cab-093b-4654-ad0d-b7588f6cee39 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.247042 Feb 21 04:19:22.793228 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 387/780] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:22 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:22.843193 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-78c8f001-ef50-463e-9b2e-fe1b214e7254 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:22.843853 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-78c8f001-ef50-463e-9b2e-fe1b214e7254 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:22.853673 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78c8f001-ef50-463e-9b2e-fe1b214e7254 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:22.854277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78c8f001-ef50-463e-9b2e-fe1b214e7254 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:22.855333 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78c8f001-ef50-463e-9b2e-fe1b214e7254 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:22.855936 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78c8f001-ef50-463e-9b2e-fe1b214e7254 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:23.023257 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-78c8f001-ef50-463e-9b2e-fe1b214e7254 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:23.033297 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-78c8f001-ef50-463e-9b2e-fe1b214e7254 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.195009 Feb 21 04:19:23.034763 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 394/781] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:22 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:23.565239 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d7cf9ddd-e172-403e-9f45-d1ab2f586496 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:23.566234 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d7cf9ddd-e172-403e-9f45-d1ab2f586496 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:23.583996 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d7cf9ddd-e172-403e-9f45-d1ab2f586496 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:23.584483 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d7cf9ddd-e172-403e-9f45-d1ab2f586496 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:23.585329 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d7cf9ddd-e172-403e-9f45-d1ab2f586496 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:23.585772 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d7cf9ddd-e172-403e-9f45-d1ab2f586496 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:23.737112 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6ed0f521-bb07-4b3f-897b-7cc2c5103625 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:23.747845 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6ed0f521-bb07-4b3f-897b-7cc2c5103625 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:23.758469 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6ed0f521-bb07-4b3f-897b-7cc2c5103625 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:23.759287 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6ed0f521-bb07-4b3f-897b-7cc2c5103625 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:23.760304 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6ed0f521-bb07-4b3f-897b-7cc2c5103625 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:23.761028 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6ed0f521-bb07-4b3f-897b-7cc2c5103625 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:23.802937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d7cf9ddd-e172-403e-9f45-d1ab2f586496 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:23.817473 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d7cf9ddd-e172-403e-9f45-d1ab2f586496 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.260190 Feb 21 04:19:23.819586 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 388/782] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:23 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:23.832230 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8865e039-63c8-4c76-ba2a-1fe0a5a1c0ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:23.833234 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8865e039-63c8-4c76-ba2a-1fe0a5a1c0ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:23.845427 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8865e039-63c8-4c76-ba2a-1fe0a5a1c0ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:23.849869 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8865e039-63c8-4c76-ba2a-1fe0a5a1c0ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:23.851423 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8865e039-63c8-4c76-ba2a-1fe0a5a1c0ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:23.852481 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8865e039-63c8-4c76-ba2a-1fe0a5a1c0ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:24.150986 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6ed0f521-bb07-4b3f-897b-7cc2c5103625 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:24.161859 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6ed0f521-bb07-4b3f-897b-7cc2c5103625 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:24.163308 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6ed0f521-bb07-4b3f-897b-7cc2c5103625 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:24.164973 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6ed0f521-bb07-4b3f-897b-7cc2c5103625 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.438750 Feb 21 04:19:24.190434 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 395/783] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:23 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:24.195728 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-2cb17602-9138-4135-bc8f-9caf4c65db62 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:24.196351 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-2cb17602-9138-4135-bc8f-9caf4c65db62 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:24.203224 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2cb17602-9138-4135-bc8f-9caf4c65db62 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:24.203685 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2cb17602-9138-4135-bc8f-9caf4c65db62 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:24.205409 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2cb17602-9138-4135-bc8f-9caf4c65db62 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:24.205852 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2cb17602-9138-4135-bc8f-9caf4c65db62 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:24.300926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8865e039-63c8-4c76-ba2a-1fe0a5a1c0ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:24.330367 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8865e039-63c8-4c76-ba2a-1fe0a5a1c0ee tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.507509 Feb 21 04:19:24.334417 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 389/784] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:23 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:24.467346 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-2cb17602-9138-4135-bc8f-9caf4c65db62 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:24.474182 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-2cb17602-9138-4135-bc8f-9caf4c65db62 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.282553 Feb 21 04:19:24.475675 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 396/785] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:24 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:24.834733 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-29317100-9ee7-48ff-9eb5-71edac220021 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:24.835348 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-29317100-9ee7-48ff-9eb5-71edac220021 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:24.842236 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-29317100-9ee7-48ff-9eb5-71edac220021 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:24.843024 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-29317100-9ee7-48ff-9eb5-71edac220021 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:24.843953 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-29317100-9ee7-48ff-9eb5-71edac220021 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:24.845063 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-29317100-9ee7-48ff-9eb5-71edac220021 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:25.008986 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-29317100-9ee7-48ff-9eb5-71edac220021 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:25.017153 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-29317100-9ee7-48ff-9eb5-71edac220021 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.185496 Feb 21 04:19:25.017755 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 390/786] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:24 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:25.184875 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ef5f2029-8926-4351-a6e8-d524e21fdfbe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:25.185557 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ef5f2029-8926-4351-a6e8-d524e21fdfbe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:25.193679 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ef5f2029-8926-4351-a6e8-d524e21fdfbe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:25.194242 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ef5f2029-8926-4351-a6e8-d524e21fdfbe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:25.195236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ef5f2029-8926-4351-a6e8-d524e21fdfbe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:25.195856 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ef5f2029-8926-4351-a6e8-d524e21fdfbe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:25.360838 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-37734675-e42e-4c29-a98c-77c88bd6e05e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:25.361461 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-37734675-e42e-4c29-a98c-77c88bd6e05e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:25.370109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-37734675-e42e-4c29-a98c-77c88bd6e05e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:25.370561 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-37734675-e42e-4c29-a98c-77c88bd6e05e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:25.371360 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-37734675-e42e-4c29-a98c-77c88bd6e05e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:25.371805 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-37734675-e42e-4c29-a98c-77c88bd6e05e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:25.416839 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ef5f2029-8926-4351-a6e8-d524e21fdfbe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:25.426377 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ef5f2029-8926-4351-a6e8-d524e21fdfbe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:25.428490 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ef5f2029-8926-4351-a6e8-d524e21fdfbe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:25.430121 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ef5f2029-8926-4351-a6e8-d524e21fdfbe tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.250357 Feb 21 04:19:25.444092 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 397/787] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:25 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:25.501221 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0bfa4fe0-6dff-4b02-8284-c8ad1e87211c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:25.501846 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0bfa4fe0-6dff-4b02-8284-c8ad1e87211c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:25.507871 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0bfa4fe0-6dff-4b02-8284-c8ad1e87211c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:25.508329 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0bfa4fe0-6dff-4b02-8284-c8ad1e87211c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:25.509153 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0bfa4fe0-6dff-4b02-8284-c8ad1e87211c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:25.509593 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0bfa4fe0-6dff-4b02-8284-c8ad1e87211c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:25.578564 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-37734675-e42e-4c29-a98c-77c88bd6e05e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:25.586920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-37734675-e42e-4c29-a98c-77c88bd6e05e tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.229681 Feb 21 04:19:25.587696 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 391/788] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:25 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:25.702141 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0bfa4fe0-6dff-4b02-8284-c8ad1e87211c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:25.715496 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0bfa4fe0-6dff-4b02-8284-c8ad1e87211c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.218228 Feb 21 04:19:25.727231 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 398/789] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:25 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:26.040086 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8effaabe-8cdb-41f9-a03c-9ebef9146f07 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:26.041079 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8effaabe-8cdb-41f9-a03c-9ebef9146f07 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:26.050482 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8effaabe-8cdb-41f9-a03c-9ebef9146f07 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:26.050929 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8effaabe-8cdb-41f9-a03c-9ebef9146f07 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:26.051800 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8effaabe-8cdb-41f9-a03c-9ebef9146f07 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:26.052242 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8effaabe-8cdb-41f9-a03c-9ebef9146f07 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:26.223029 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8effaabe-8cdb-41f9-a03c-9ebef9146f07 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:26.233347 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8effaabe-8cdb-41f9-a03c-9ebef9146f07 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.199685 Feb 21 04:19:26.244475 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 392/790] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:26 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:26.510371 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9e1707cf-974e-48be-8bfa-f8766fb23556 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:26.553782 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9e1707cf-974e-48be-8bfa-f8766fb23556 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:26.571870 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e1707cf-974e-48be-8bfa-f8766fb23556 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:26.572349 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e1707cf-974e-48be-8bfa-f8766fb23556 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:26.573526 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e1707cf-974e-48be-8bfa-f8766fb23556 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:26.573978 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9e1707cf-974e-48be-8bfa-f8766fb23556 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:26.629426 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f4f28cac-4312-4870-9c70-659937cdd259 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:26.630039 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f4f28cac-4312-4870-9c70-659937cdd259 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:26.648998 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f4f28cac-4312-4870-9c70-659937cdd259 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:26.649448 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f4f28cac-4312-4870-9c70-659937cdd259 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:26.650246 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f4f28cac-4312-4870-9c70-659937cdd259 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:26.650675 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f4f28cac-4312-4870-9c70-659937cdd259 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:26.832291 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9e1707cf-974e-48be-8bfa-f8766fb23556 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:26.841911 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9e1707cf-974e-48be-8bfa-f8766fb23556 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:26.851665 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9e1707cf-974e-48be-8bfa-f8766fb23556 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:26.861933 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9e1707cf-974e-48be-8bfa-f8766fb23556 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.367971 Feb 21 04:19:26.862925 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 399/791] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:26 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:26.891446 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-80aa5961-c808-4ccb-817b-d2b0473554d7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:26.892213 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-80aa5961-c808-4ccb-817b-d2b0473554d7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:26.898668 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-80aa5961-c808-4ccb-817b-d2b0473554d7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:26.899256 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-80aa5961-c808-4ccb-817b-d2b0473554d7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:26.900167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-80aa5961-c808-4ccb-817b-d2b0473554d7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:26.901394 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-80aa5961-c808-4ccb-817b-d2b0473554d7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:26.985858 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f4f28cac-4312-4870-9c70-659937cdd259 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:26.994551 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f4f28cac-4312-4870-9c70-659937cdd259 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.368688 Feb 21 04:19:27.008302 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 393/792] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:26 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:27.091710 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-80aa5961-c808-4ccb-817b-d2b0473554d7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:27.102970 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-80aa5961-c808-4ccb-817b-d2b0473554d7 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.216990 Feb 21 04:19:27.103582 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 400/793] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:26 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:27.251665 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4240a86e-d48c-4a8d-9107-6ae458beddc3 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:27.253067 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4240a86e-d48c-4a8d-9107-6ae458beddc3 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:27.259547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4240a86e-d48c-4a8d-9107-6ae458beddc3 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:27.260081 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4240a86e-d48c-4a8d-9107-6ae458beddc3 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:27.260984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4240a86e-d48c-4a8d-9107-6ae458beddc3 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:27.261482 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4240a86e-d48c-4a8d-9107-6ae458beddc3 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:27.406420 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4240a86e-d48c-4a8d-9107-6ae458beddc3 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:27.414422 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4240a86e-d48c-4a8d-9107-6ae458beddc3 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.166856 Feb 21 04:19:27.415212 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 394/794] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:27 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:27.879726 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-45c47fbc-8736-45dc-b036-0787a5e2d3a0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:27.880415 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-45c47fbc-8736-45dc-b036-0787a5e2d3a0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:27.886865 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-45c47fbc-8736-45dc-b036-0787a5e2d3a0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:27.887317 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-45c47fbc-8736-45dc-b036-0787a5e2d3a0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:27.888087 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-45c47fbc-8736-45dc-b036-0787a5e2d3a0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:27.888516 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-45c47fbc-8736-45dc-b036-0787a5e2d3a0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:28.014930 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-18a04c5a-8ecd-44db-a4f8-6f8248459396 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:28.015544 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-18a04c5a-8ecd-44db-a4f8-6f8248459396 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:28.023444 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18a04c5a-8ecd-44db-a4f8-6f8248459396 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:28.023896 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18a04c5a-8ecd-44db-a4f8-6f8248459396 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:28.028751 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18a04c5a-8ecd-44db-a4f8-6f8248459396 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:28.029232 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18a04c5a-8ecd-44db-a4f8-6f8248459396 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:28.033044 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-45c47fbc-8736-45dc-b036-0787a5e2d3a0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:28.043610 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-45c47fbc-8736-45dc-b036-0787a5e2d3a0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:28.045438 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-45c47fbc-8736-45dc-b036-0787a5e2d3a0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:28.046857 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-45c47fbc-8736-45dc-b036-0787a5e2d3a0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.171400 Feb 21 04:19:28.059042 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 401/795] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:27 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:28.119089 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-913b8f36-4447-4b21-bf50-a6943dea51bb tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:28.119872 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-913b8f36-4447-4b21-bf50-a6943dea51bb tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:28.135094 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-913b8f36-4447-4b21-bf50-a6943dea51bb tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:28.137677 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-913b8f36-4447-4b21-bf50-a6943dea51bb tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:28.138590 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-913b8f36-4447-4b21-bf50-a6943dea51bb tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:28.141084 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-913b8f36-4447-4b21-bf50-a6943dea51bb tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:28.220787 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-18a04c5a-8ecd-44db-a4f8-6f8248459396 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:28.230662 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-18a04c5a-8ecd-44db-a4f8-6f8248459396 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.219105 Feb 21 04:19:28.231409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 395/796] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:28 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:28.304709 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-913b8f36-4447-4b21-bf50-a6943dea51bb tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:28.312315 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-913b8f36-4447-4b21-bf50-a6943dea51bb tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.196919 Feb 21 04:19:28.322071 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 402/797] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:28 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:28.431228 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-03f57d18-b2e4-48c1-8198-3836f9ee9a66 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:28.432738 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-03f57d18-b2e4-48c1-8198-3836f9ee9a66 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:28.440128 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03f57d18-b2e4-48c1-8198-3836f9ee9a66 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:28.440873 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03f57d18-b2e4-48c1-8198-3836f9ee9a66 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:28.441712 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03f57d18-b2e4-48c1-8198-3836f9ee9a66 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:28.442376 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-03f57d18-b2e4-48c1-8198-3836f9ee9a66 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:28.587182 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-03f57d18-b2e4-48c1-8198-3836f9ee9a66 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:28.597108 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-03f57d18-b2e4-48c1-8198-3836f9ee9a66 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.169578 Feb 21 04:19:28.597682 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 396/798] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:28 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:29.066413 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-98a93f8b-771a-4fc1-b256-054dc8cf4f85 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:29.067814 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-98a93f8b-771a-4fc1-b256-054dc8cf4f85 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:29.077700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-98a93f8b-771a-4fc1-b256-054dc8cf4f85 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:29.078288 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-98a93f8b-771a-4fc1-b256-054dc8cf4f85 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:29.079439 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-98a93f8b-771a-4fc1-b256-054dc8cf4f85 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:29.080031 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-98a93f8b-771a-4fc1-b256-054dc8cf4f85 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:29.248681 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1a9f0fc6-1256-48c0-b44a-bedc68256750 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:29.249596 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1a9f0fc6-1256-48c0-b44a-bedc68256750 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:29.259630 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-98a93f8b-771a-4fc1-b256-054dc8cf4f85 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:29.268624 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-98a93f8b-771a-4fc1-b256-054dc8cf4f85 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:29.271422 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1a9f0fc6-1256-48c0-b44a-bedc68256750 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:29.271884 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1a9f0fc6-1256-48c0-b44a-bedc68256750 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:29.272695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1a9f0fc6-1256-48c0-b44a-bedc68256750 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:29.273119 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1a9f0fc6-1256-48c0-b44a-bedc68256750 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:29.275937 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-98a93f8b-771a-4fc1-b256-054dc8cf4f85 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:29.277203 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-98a93f8b-771a-4fc1-b256-054dc8cf4f85 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.215505 Feb 21 04:19:29.289416 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 403/799] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:29 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:29.329540 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8d565bd7-6215-4ade-90b9-ee44c5ee67d2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:29.330332 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-8d565bd7-6215-4ade-90b9-ee44c5ee67d2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:29.336603 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8d565bd7-6215-4ade-90b9-ee44c5ee67d2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:29.337099 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8d565bd7-6215-4ade-90b9-ee44c5ee67d2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:29.337896 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8d565bd7-6215-4ade-90b9-ee44c5ee67d2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:29.338333 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8d565bd7-6215-4ade-90b9-ee44c5ee67d2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:29.470635 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1a9f0fc6-1256-48c0-b44a-bedc68256750 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:29.486097 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1a9f0fc6-1256-48c0-b44a-bedc68256750 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.241157 Feb 21 04:19:29.486683 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 397/800] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:29 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:29.546914 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8d565bd7-6215-4ade-90b9-ee44c5ee67d2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:29.556955 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-8d565bd7-6215-4ade-90b9-ee44c5ee67d2 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.231289 Feb 21 04:19:29.566991 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 404/801] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:29 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:29.613930 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-dba05641-0257-4892-b878-4ba0dd2bc06e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:29.614660 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-dba05641-0257-4892-b878-4ba0dd2bc06e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:29.623976 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dba05641-0257-4892-b878-4ba0dd2bc06e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:29.624944 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dba05641-0257-4892-b878-4ba0dd2bc06e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:29.626040 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dba05641-0257-4892-b878-4ba0dd2bc06e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:29.626671 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-dba05641-0257-4892-b878-4ba0dd2bc06e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:29.804527 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-dba05641-0257-4892-b878-4ba0dd2bc06e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:29.811970 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-dba05641-0257-4892-b878-4ba0dd2bc06e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.201700 Feb 21 04:19:29.812586 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 398/802] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:29 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:30.310403 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ae290246-698a-4923-a899-bd55c455aee3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:30.317091 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ae290246-698a-4923-a899-bd55c455aee3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:30.326018 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ae290246-698a-4923-a899-bd55c455aee3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:30.326624 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ae290246-698a-4923-a899-bd55c455aee3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:30.327486 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ae290246-698a-4923-a899-bd55c455aee3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:30.327985 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ae290246-698a-4923-a899-bd55c455aee3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:30.493808 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ae290246-698a-4923-a899-bd55c455aee3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:30.506047 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ae290246-698a-4923-a899-bd55c455aee3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:30.507273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-93ac1160-5bed-4d97-b29c-f6d86538aa7a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:30.508131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ae290246-698a-4923-a899-bd55c455aee3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:30.508897 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ae290246-698a-4923-a899-bd55c455aee3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.215737 Feb 21 04:19:30.509475 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 405/803] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:30 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:30.509823 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-93ac1160-5bed-4d97-b29c-f6d86538aa7a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:30.518003 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-93ac1160-5bed-4d97-b29c-f6d86538aa7a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:30.518453 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-93ac1160-5bed-4d97-b29c-f6d86538aa7a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:30.519326 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-93ac1160-5bed-4d97-b29c-f6d86538aa7a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:30.519831 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-93ac1160-5bed-4d97-b29c-f6d86538aa7a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:30.574445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a422cff8-0583-488f-9554-9a5d525cbf78 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:30.575052 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a422cff8-0583-488f-9554-9a5d525cbf78 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:30.581074 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a422cff8-0583-488f-9554-9a5d525cbf78 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:30.581670 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a422cff8-0583-488f-9554-9a5d525cbf78 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:30.585129 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a422cff8-0583-488f-9554-9a5d525cbf78 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:30.585583 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a422cff8-0583-488f-9554-9a5d525cbf78 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:30.773268 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-93ac1160-5bed-4d97-b29c-f6d86538aa7a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:30.783988 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a422cff8-0583-488f-9554-9a5d525cbf78 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:30.787608 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-93ac1160-5bed-4d97-b29c-f6d86538aa7a tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.281153 Feb 21 04:19:30.788246 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 399/804] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:30 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:30.793715 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a422cff8-0583-488f-9554-9a5d525cbf78 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.223006 Feb 21 04:19:30.794839 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 406/805] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:30 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:30.829832 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-415cfbaa-c6d7-4f84-b72c-24610f947564 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:30.830046 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-415cfbaa-c6d7-4f84-b72c-24610f947564 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:30.836375 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-415cfbaa-c6d7-4f84-b72c-24610f947564 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:30.836856 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-415cfbaa-c6d7-4f84-b72c-24610f947564 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:30.837645 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-415cfbaa-c6d7-4f84-b72c-24610f947564 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:30.838078 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-415cfbaa-c6d7-4f84-b72c-24610f947564 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:30.981162 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-415cfbaa-c6d7-4f84-b72c-24610f947564 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:30.989136 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-415cfbaa-c6d7-4f84-b72c-24610f947564 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.163540 Feb 21 04:19:30.990453 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 400/806] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:30 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:31.529116 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-df07c1d8-f044-4657-ad7b-06e86c664050 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:31.529811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-df07c1d8-f044-4657-ad7b-06e86c664050 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:31.537195 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-df07c1d8-f044-4657-ad7b-06e86c664050 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:31.538087 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-df07c1d8-f044-4657-ad7b-06e86c664050 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:31.539458 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-df07c1d8-f044-4657-ad7b-06e86c664050 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:31.539896 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-df07c1d8-f044-4657-ad7b-06e86c664050 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:31.671428 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-df07c1d8-f044-4657-ad7b-06e86c664050 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:31.679911 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-df07c1d8-f044-4657-ad7b-06e86c664050 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:31.681425 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-df07c1d8-f044-4657-ad7b-06e86c664050 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:31.682579 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-df07c1d8-f044-4657-ad7b-06e86c664050 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.158808 Feb 21 04:19:31.683131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 407/807] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:31 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:31.804367 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4bdbddd5-9a19-4a7f-a157-4176b1c8cf8b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:31.804951 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4bdbddd5-9a19-4a7f-a157-4176b1c8cf8b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:31.810662 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5fa97a4e-db63-4bd0-9234-872721c9b64c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:31.811214 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4bdbddd5-9a19-4a7f-a157-4176b1c8cf8b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:31.811345 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5fa97a4e-db63-4bd0-9234-872721c9b64c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:31.811867 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4bdbddd5-9a19-4a7f-a157-4176b1c8cf8b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:31.812476 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4bdbddd5-9a19-4a7f-a157-4176b1c8cf8b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:31.812970 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4bdbddd5-9a19-4a7f-a157-4176b1c8cf8b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:31.817749 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5fa97a4e-db63-4bd0-9234-872721c9b64c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:31.818205 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5fa97a4e-db63-4bd0-9234-872721c9b64c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:31.818981 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5fa97a4e-db63-4bd0-9234-872721c9b64c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:31.819414 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5fa97a4e-db63-4bd0-9234-872721c9b64c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:32.027648 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5fa97a4e-db63-4bd0-9234-872721c9b64c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:32.031132 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4bdbddd5-9a19-4a7f-a157-4176b1c8cf8b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:32.035433 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5fa97a4e-db63-4bd0-9234-872721c9b64c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.228315 Feb 21 04:19:32.036013 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 408/808] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:31 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:32.042273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4bdbddd5-9a19-4a7f-a157-4176b1c8cf8b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.238017 Feb 21 04:19:32.042273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 401/809] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:31 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:32.042479 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-34b89558-deec-4781-b224-f36d6d2c5614 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:32.042479 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-34b89558-deec-4781-b224-f36d6d2c5614 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:32.047823 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-34b89558-deec-4781-b224-f36d6d2c5614 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:32.048276 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-34b89558-deec-4781-b224-f36d6d2c5614 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:32.049105 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-34b89558-deec-4781-b224-f36d6d2c5614 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:32.049540 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-34b89558-deec-4781-b224-f36d6d2c5614 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:32.184123 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-34b89558-deec-4781-b224-f36d6d2c5614 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:32.193532 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-34b89558-deec-4781-b224-f36d6d2c5614 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.155844 Feb 21 04:19:32.194126 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 409/810] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:32 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:32.701326 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5c1631cf-ca11-4b22-9f88-16a36d64686a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:32.701867 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5c1631cf-ca11-4b22-9f88-16a36d64686a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:32.708351 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c1631cf-ca11-4b22-9f88-16a36d64686a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:32.708832 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c1631cf-ca11-4b22-9f88-16a36d64686a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:32.709640 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c1631cf-ca11-4b22-9f88-16a36d64686a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:32.710097 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5c1631cf-ca11-4b22-9f88-16a36d64686a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:32.861741 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5c1631cf-ca11-4b22-9f88-16a36d64686a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:32.870265 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5c1631cf-ca11-4b22-9f88-16a36d64686a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:32.871749 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5c1631cf-ca11-4b22-9f88-16a36d64686a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:32.872946 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5c1631cf-ca11-4b22-9f88-16a36d64686a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.175879 Feb 21 04:19:32.873494 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 402/811] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:32 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:33.052117 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-04986bcc-f432-4c8c-b519-a42cb91d3679 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:33.052869 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-04986bcc-f432-4c8c-b519-a42cb91d3679 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:33.055617 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fb6badd5-05ae-4789-9b2b-8cfc0c2fe02b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:33.056227 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fb6badd5-05ae-4789-9b2b-8cfc0c2fe02b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:33.059141 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-04986bcc-f432-4c8c-b519-a42cb91d3679 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:33.059587 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-04986bcc-f432-4c8c-b519-a42cb91d3679 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:33.060393 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-04986bcc-f432-4c8c-b519-a42cb91d3679 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:33.061048 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-04986bcc-f432-4c8c-b519-a42cb91d3679 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:33.061987 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb6badd5-05ae-4789-9b2b-8cfc0c2fe02b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:33.062432 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb6badd5-05ae-4789-9b2b-8cfc0c2fe02b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:33.063205 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb6badd5-05ae-4789-9b2b-8cfc0c2fe02b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:33.063637 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb6badd5-05ae-4789-9b2b-8cfc0c2fe02b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:33.254385 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-04986bcc-f432-4c8c-b519-a42cb91d3679 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:33.261523 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-04986bcc-f432-4c8c-b519-a42cb91d3679 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.213861 Feb 21 04:19:33.262096 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 410/812] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:33 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:33.266770 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e3bcbcf3-427c-4686-8155-56132e2c0b2f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:33.267528 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e3bcbcf3-427c-4686-8155-56132e2c0b2f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:33.267657 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fb6badd5-05ae-4789-9b2b-8cfc0c2fe02b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:33.273209 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e3bcbcf3-427c-4686-8155-56132e2c0b2f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:33.273658 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e3bcbcf3-427c-4686-8155-56132e2c0b2f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:33.274433 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e3bcbcf3-427c-4686-8155-56132e2c0b2f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:33.274866 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e3bcbcf3-427c-4686-8155-56132e2c0b2f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:33.275383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fb6badd5-05ae-4789-9b2b-8cfc0c2fe02b tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.223392 Feb 21 04:19:33.275940 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 403/813] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:33 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:33.403501 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e3bcbcf3-427c-4686-8155-56132e2c0b2f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:33.410613 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e3bcbcf3-427c-4686-8155-56132e2c0b2f tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.147326 Feb 21 04:19:33.411179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 411/814] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:33 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:33.891054 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-af92fd6d-b0c9-4d6e-a41d-9de0bbd63339 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:33.891659 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-af92fd6d-b0c9-4d6e-a41d-9de0bbd63339 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:33.902164 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-af92fd6d-b0c9-4d6e-a41d-9de0bbd63339 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:33.902611 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-af92fd6d-b0c9-4d6e-a41d-9de0bbd63339 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:33.903651 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-af92fd6d-b0c9-4d6e-a41d-9de0bbd63339 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:33.904071 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-af92fd6d-b0c9-4d6e-a41d-9de0bbd63339 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:34.144250 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-af92fd6d-b0c9-4d6e-a41d-9de0bbd63339 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:34.152366 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-af92fd6d-b0c9-4d6e-a41d-9de0bbd63339 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:34.154133 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-af92fd6d-b0c9-4d6e-a41d-9de0bbd63339 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:34.155290 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-af92fd6d-b0c9-4d6e-a41d-9de0bbd63339 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.267880 Feb 21 04:19:34.155850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 404/815] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:33 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:34.277206 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-20ea092f-97cd-441c-ab2e-3806c9fc63dc tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:34.277820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-20ea092f-97cd-441c-ab2e-3806c9fc63dc tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:34.284867 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-20ea092f-97cd-441c-ab2e-3806c9fc63dc tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:34.285312 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-20ea092f-97cd-441c-ab2e-3806c9fc63dc tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:34.286122 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-20ea092f-97cd-441c-ab2e-3806c9fc63dc tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:34.286535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-20ea092f-97cd-441c-ab2e-3806c9fc63dc tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:34.293012 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9c22cace-316c-418a-bb4f-9739734441b4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:34.293875 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9c22cace-316c-418a-bb4f-9739734441b4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:34.300814 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9c22cace-316c-418a-bb4f-9739734441b4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:34.301393 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9c22cace-316c-418a-bb4f-9739734441b4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:34.302282 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9c22cace-316c-418a-bb4f-9739734441b4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:34.302818 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9c22cace-316c-418a-bb4f-9739734441b4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:34.620751 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-20ea092f-97cd-441c-ab2e-3806c9fc63dc tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:34.629151 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-20ea092f-97cd-441c-ab2e-3806c9fc63dc tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.355574 Feb 21 04:19:34.629774 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9c22cace-316c-418a-bb4f-9739734441b4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:34.639383 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 412/816] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:34 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:34.644413 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e785134e-e36b-4c44-a07a-b47a9e845c0a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:34.645260 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e785134e-e36b-4c44-a07a-b47a9e845c0a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:34.648415 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9c22cace-316c-418a-bb4f-9739734441b4 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.359976 Feb 21 04:19:34.649164 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 405/817] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:34 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:34.655284 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e785134e-e36b-4c44-a07a-b47a9e845c0a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:34.656001 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e785134e-e36b-4c44-a07a-b47a9e845c0a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:34.657022 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e785134e-e36b-4c44-a07a-b47a9e845c0a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:34.657453 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e785134e-e36b-4c44-a07a-b47a9e845c0a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:34.797597 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e785134e-e36b-4c44-a07a-b47a9e845c0a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:34.805393 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e785134e-e36b-4c44-a07a-b47a9e845c0a tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.165089 Feb 21 04:19:34.805950 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 413/818] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:34 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:35.172999 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e35beb6f-453f-460b-9a7e-80659f00815e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:35.174191 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e35beb6f-453f-460b-9a7e-80659f00815e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:35.180427 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e35beb6f-453f-460b-9a7e-80659f00815e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:35.180901 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e35beb6f-453f-460b-9a7e-80659f00815e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:35.181679 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e35beb6f-453f-460b-9a7e-80659f00815e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:35.182108 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e35beb6f-453f-460b-9a7e-80659f00815e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:35.318800 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e35beb6f-453f-460b-9a7e-80659f00815e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:35.326884 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e35beb6f-453f-460b-9a7e-80659f00815e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:35.328360 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e35beb6f-453f-460b-9a7e-80659f00815e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:35.329571 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e35beb6f-453f-460b-9a7e-80659f00815e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.160250 Feb 21 04:19:35.330205 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 406/819] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:35 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:35.645825 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-40cd344e-65df-47d6-aa70-bd2d8cbcfb2c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:35.646448 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-40cd344e-65df-47d6-aa70-bd2d8cbcfb2c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:35.653966 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-40cd344e-65df-47d6-aa70-bd2d8cbcfb2c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:35.654427 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-40cd344e-65df-47d6-aa70-bd2d8cbcfb2c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:35.655220 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-40cd344e-65df-47d6-aa70-bd2d8cbcfb2c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:35.655657 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-40cd344e-65df-47d6-aa70-bd2d8cbcfb2c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:35.667352 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0b342027-ac98-4944-84a9-d7b32ebbd1b2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:35.668485 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0b342027-ac98-4944-84a9-d7b32ebbd1b2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:35.679475 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0b342027-ac98-4944-84a9-d7b32ebbd1b2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:35.680192 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0b342027-ac98-4944-84a9-d7b32ebbd1b2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:35.681530 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0b342027-ac98-4944-84a9-d7b32ebbd1b2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:35.682421 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0b342027-ac98-4944-84a9-d7b32ebbd1b2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:35.990765 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-40cd344e-65df-47d6-aa70-bd2d8cbcfb2c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:35.998105 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-40cd344e-65df-47d6-aa70-bd2d8cbcfb2c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.356319 Feb 21 04:19:36.004697 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0b342027-ac98-4944-84a9-d7b32ebbd1b2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:36.008491 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 414/820] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:35 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:36.013900 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-63838c13-b064-440f-9da8-d57346bfe5c2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:36.014522 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-63838c13-b064-440f-9da8-d57346bfe5c2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:36.021805 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-63838c13-b064-440f-9da8-d57346bfe5c2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:36.022261 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-63838c13-b064-440f-9da8-d57346bfe5c2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:36.022505 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0b342027-ac98-4944-84a9-d7b32ebbd1b2 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1515 microversion: 2.1 time: 0.359717 Feb 21 04:19:36.023053 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-63838c13-b064-440f-9da8-d57346bfe5c2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:36.023491 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-63838c13-b064-440f-9da8-d57346bfe5c2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:36.024860 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 407/821] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:35 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1515 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:36.260242 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-63838c13-b064-440f-9da8-d57346bfe5c2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:36.269807 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-63838c13-b064-440f-9da8-d57346bfe5c2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.259978 Feb 21 04:19:36.270387 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 415/822] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:36 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:36.350191 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-37502f0b-fca7-40b6-b2b8-d8820a25464f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:36.350782 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-37502f0b-fca7-40b6-b2b8-d8820a25464f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:36.356838 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-37502f0b-fca7-40b6-b2b8-d8820a25464f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:36.357313 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-37502f0b-fca7-40b6-b2b8-d8820a25464f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:36.358152 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-37502f0b-fca7-40b6-b2b8-d8820a25464f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:36.358597 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-37502f0b-fca7-40b6-b2b8-d8820a25464f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:36.463392 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-242a32c8-7d08-49d4-9ebe-5c7236bddbbb req-f1cc4018-5ec3-4a87-9ec8-f76bfac142be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a128817-df9b-46f1-902b-03d1cbcddb7d", "name": "network-vif-deleted", "tag": "ad59d774-1de8-45e3-a9d1-6d9c1aeca36e"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:36.465123 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:19:36.465123 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:19:36.473884 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-242a32c8-7d08-49d4-9ebe-5c7236bddbbb req-f1cc4018-5ec3-4a87-9ec8-f76bfac142be service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:36.474355 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-242a32c8-7d08-49d4-9ebe-5c7236bddbbb req-f1cc4018-5ec3-4a87-9ec8-f76bfac142be service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:36.485462 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-242a32c8-7d08-49d4-9ebe-5c7236bddbbb req-f1cc4018-5ec3-4a87-9ec8-f76bfac142be service nova] Creating event network-vif-deleted:ad59d774-1de8-45e3-a9d1-6d9c1aeca36e for instance 4a128817-df9b-46f1-902b-03d1cbcddb7d on hv-cinder-77398 Feb 21 04:19:36.492361 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-242a32c8-7d08-49d4-9ebe-5c7236bddbbb req-f1cc4018-5ec3-4a87-9ec8-f76bfac142be service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179020 Feb 21 04:19:36.494501 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 408/823] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:19:36.510995 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-37502f0b-fca7-40b6-b2b8-d8820a25464f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:36.519140 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-37502f0b-fca7-40b6-b2b8-d8820a25464f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:36.520659 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-37502f0b-fca7-40b6-b2b8-d8820a25464f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:36.521841 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-37502f0b-fca7-40b6-b2b8-d8820a25464f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.177979 Feb 21 04:19:36.522402 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 416/824] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:36 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:37.015904 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-92f7b91e-817e-42ed-9ddd-6dab759736f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:37.016588 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-92f7b91e-817e-42ed-9ddd-6dab759736f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:37.023132 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-92f7b91e-817e-42ed-9ddd-6dab759736f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:37.023530 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-92f7b91e-817e-42ed-9ddd-6dab759736f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:37.024296 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-92f7b91e-817e-42ed-9ddd-6dab759736f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:37.024764 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-92f7b91e-817e-42ed-9ddd-6dab759736f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:37.039462 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6da9e7da-4ee9-4efe-9d8f-b6f20ddba29c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:37.040067 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6da9e7da-4ee9-4efe-9d8f-b6f20ddba29c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:37.046404 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6da9e7da-4ee9-4efe-9d8f-b6f20ddba29c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:37.046854 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6da9e7da-4ee9-4efe-9d8f-b6f20ddba29c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:37.047634 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6da9e7da-4ee9-4efe-9d8f-b6f20ddba29c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:37.048069 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6da9e7da-4ee9-4efe-9d8f-b6f20ddba29c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:37.083847 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6da9e7da-4ee9-4efe-9d8f-b6f20ddba29c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:37.084761 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6da9e7da-4ee9-4efe-9d8f-b6f20ddba29c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:37.085312 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-6da9e7da-4ee9-4efe-9d8f-b6f20ddba29c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lazy-loading 'fault' on Instance uuid 4a128817-df9b-46f1-902b-03d1cbcddb7d {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:19:37.129795 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6da9e7da-4ee9-4efe-9d8f-b6f20ddba29c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:37.138063 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6da9e7da-4ee9-4efe-9d8f-b6f20ddba29c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 200 len: 1308 microversion: 2.1 time: 0.102199 Feb 21 04:19:37.138969 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 417/825] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:37 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:37.203095 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-92f7b91e-817e-42ed-9ddd-6dab759736f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:37.213114 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-92f7b91e-817e-42ed-9ddd-6dab759736f0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.201127 Feb 21 04:19:37.213984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 409/826] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:37 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:37.287456 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-36a763ac-7223-4cc0-9f5d-836be9c6f6aa tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:37.288192 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-36a763ac-7223-4cc0-9f5d-836be9c6f6aa tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:37.295277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-36a763ac-7223-4cc0-9f5d-836be9c6f6aa tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:37.296451 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-36a763ac-7223-4cc0-9f5d-836be9c6f6aa tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:37.297603 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-36a763ac-7223-4cc0-9f5d-836be9c6f6aa tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:37.307119 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-36a763ac-7223-4cc0-9f5d-836be9c6f6aa tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:37.438983 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-36a763ac-7223-4cc0-9f5d-836be9c6f6aa tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:37.447282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-36a763ac-7223-4cc0-9f5d-836be9c6f6aa tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.164222 Feb 21 04:19:37.452803 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 418/827] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:37 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:37.539625 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0ad838c6-2930-4b51-bc86-7087f5869b50 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:37.540314 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0ad838c6-2930-4b51-bc86-7087f5869b50 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:37.555921 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0ad838c6-2930-4b51-bc86-7087f5869b50 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:37.556435 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0ad838c6-2930-4b51-bc86-7087f5869b50 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:37.557367 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0ad838c6-2930-4b51-bc86-7087f5869b50 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:37.557808 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0ad838c6-2930-4b51-bc86-7087f5869b50 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:37.696670 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0ad838c6-2930-4b51-bc86-7087f5869b50 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:37.704648 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0ad838c6-2930-4b51-bc86-7087f5869b50 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:37.706720 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0ad838c6-2930-4b51-bc86-7087f5869b50 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:37.707882 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0ad838c6-2930-4b51-bc86-7087f5869b50 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.172030 Feb 21 04:19:37.708449 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 410/828] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:37 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:38.154918 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7b226f9a-3718-4de2-a2d6-5aa672c810d6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:38.155538 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7b226f9a-3718-4de2-a2d6-5aa672c810d6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: 4a128817-df9b-46f1-902b-03d1cbcddb7d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:38.162113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7b226f9a-3718-4de2-a2d6-5aa672c810d6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:38.162615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7b226f9a-3718-4de2-a2d6-5aa672c810d6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:38.163394 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7b226f9a-3718-4de2-a2d6-5aa672c810d6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:38.163830 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7b226f9a-3718-4de2-a2d6-5aa672c810d6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:38.176812 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-7b226f9a-3718-4de2-a2d6-5aa672c810d6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] HTTP exception thrown: Instance 4a128817-df9b-46f1-902b-03d1cbcddb7d could not be found. Feb 21 04:19:38.177396 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7b226f9a-3718-4de2-a2d6-5aa672c810d6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Returning 404 to user: Instance 4a128817-df9b-46f1-902b-03d1cbcddb7d could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:19:38.178198 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7b226f9a-3718-4de2-a2d6-5aa672c810d6 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d" status: 404 len: 111 microversion: 2.1 time: 0.027358 Feb 21 04:19:38.178712 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 419/829] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:38 2022] GET /compute/v2.1/servers/4a128817-df9b-46f1-902b-03d1cbcddb7d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:19:38.229860 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a9b597bb-bfc8-4267-8018-ac9b855a2b60 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:38.230500 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a9b597bb-bfc8-4267-8018-ac9b855a2b60 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:38.236663 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a9b597bb-bfc8-4267-8018-ac9b855a2b60 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:38.237117 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a9b597bb-bfc8-4267-8018-ac9b855a2b60 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:38.237903 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a9b597bb-bfc8-4267-8018-ac9b855a2b60 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:38.238309 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a9b597bb-bfc8-4267-8018-ac9b855a2b60 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:38.374516 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a9b597bb-bfc8-4267-8018-ac9b855a2b60 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:38.382267 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a9b597bb-bfc8-4267-8018-ac9b855a2b60 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.156041 Feb 21 04:19:38.382849 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 411/830] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:38 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:38.465471 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-181e29eb-2239-46be-b078-cf13426929a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:38.466492 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-181e29eb-2239-46be-b078-cf13426929a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:38.473040 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-181e29eb-2239-46be-b078-cf13426929a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:38.473625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-181e29eb-2239-46be-b078-cf13426929a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:38.474587 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-181e29eb-2239-46be-b078-cf13426929a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:38.475184 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-181e29eb-2239-46be-b078-cf13426929a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:38.606527 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-181e29eb-2239-46be-b078-cf13426929a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:38.614127 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-181e29eb-2239-46be-b078-cf13426929a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.153225 Feb 21 04:19:38.614903 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 420/831] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:38 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:38.725818 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-625b5bbf-bb3f-4376-822f-12873d11225d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:38.726733 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-625b5bbf-bb3f-4376-822f-12873d11225d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:38.733576 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-625b5bbf-bb3f-4376-822f-12873d11225d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:38.734018 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-625b5bbf-bb3f-4376-822f-12873d11225d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:38.734827 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-625b5bbf-bb3f-4376-822f-12873d11225d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:38.735256 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-625b5bbf-bb3f-4376-822f-12873d11225d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:38.873739 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-625b5bbf-bb3f-4376-822f-12873d11225d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:38.881746 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-625b5bbf-bb3f-4376-822f-12873d11225d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:38.883234 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-625b5bbf-bb3f-4376-822f-12873d11225d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:38.884382 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-625b5bbf-bb3f-4376-822f-12873d11225d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.162508 Feb 21 04:19:38.885038 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 412/832] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:38 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:39.308874 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-18157b30-99f8-48a1-bc81-bba5ef47ae64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:39.309384 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-18157b30-99f8-48a1-bc81-bba5ef47ae64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:39.315525 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-18157b30-99f8-48a1-bc81-bba5ef47ae64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:39.315967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-18157b30-99f8-48a1-bc81-bba5ef47ae64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:39.316767 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-18157b30-99f8-48a1-bc81-bba5ef47ae64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:39.317197 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-18157b30-99f8-48a1-bc81-bba5ef47ae64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:39.341380 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-18157b30-99f8-48a1-bc81-bba5ef47ae64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Going to try to terminate instance {{(pid=116571) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:19:39.399697 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0a8263b7-66df-413f-871d-ce8e204be271 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:39.400308 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0a8263b7-66df-413f-871d-ce8e204be271 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:39.417340 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-18157b30-99f8-48a1-bc81-bba5ef47ae64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "DELETE /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 204 len: 0 microversion: 2.1 time: 0.111628 Feb 21 04:19:39.418089 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0a8263b7-66df-413f-871d-ce8e204be271 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:39.418239 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 421/833] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:19:39 2022] DELETE /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 04:19:39.421364 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0a8263b7-66df-413f-871d-ce8e204be271 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:39.422303 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0a8263b7-66df-413f-871d-ce8e204be271 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:39.422859 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0a8263b7-66df-413f-871d-ce8e204be271 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:39.426412 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fbd1a4cd-c1c7-4757-9bbd-cd8d4274fb64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:39.427178 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fbd1a4cd-c1c7-4757-9bbd-cd8d4274fb64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:39.432874 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fbd1a4cd-c1c7-4757-9bbd-cd8d4274fb64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:39.433514 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fbd1a4cd-c1c7-4757-9bbd-cd8d4274fb64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:39.434295 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fbd1a4cd-c1c7-4757-9bbd-cd8d4274fb64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:39.434722 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fbd1a4cd-c1c7-4757-9bbd-cd8d4274fb64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:39.633109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0a8263b7-66df-413f-871d-ce8e204be271 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:39.635228 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-fbd1a4cd-c1c7-4757-9bbd-cd8d4274fb64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:39.640310 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0a8263b7-66df-413f-871d-ce8e204be271 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.244836 Feb 21 04:19:39.641108 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 413/834] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:39 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:39.642856 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fbd1a4cd-c1c7-4757-9bbd-cd8d4274fb64 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1513 microversion: 2.1 time: 0.220359 Feb 21 04:19:39.652790 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 422/835] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:39 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:39.655171 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-4ed896ac-ef34-490b-a129-4bb1ea189bbe req-37c7e55d-54e0-4377-bb5e-d0cd08739188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea586516-1575-4b69-b10e-b3f281b70c99", "name": "network-vif-plugged", "status": "completed", "tag": "717f4f68-10eb-467f-bfc7-a3b1a1bfc78f"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:39.656781 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:19:39.656781 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:19:39.657424 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fab4a527-c526-4934-8d01-d3537bd10e97 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:39.658119 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fab4a527-c526-4934-8d01-d3537bd10e97 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:39.664947 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-4ed896ac-ef34-490b-a129-4bb1ea189bbe req-37c7e55d-54e0-4377-bb5e-d0cd08739188 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:39.664947 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-4ed896ac-ef34-490b-a129-4bb1ea189bbe req-37c7e55d-54e0-4377-bb5e-d0cd08739188 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:39.671015 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fab4a527-c526-4934-8d01-d3537bd10e97 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:39.671464 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fab4a527-c526-4934-8d01-d3537bd10e97 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:39.672281 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fab4a527-c526-4934-8d01-d3537bd10e97 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:39.672757 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fab4a527-c526-4934-8d01-d3537bd10e97 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:39.676960 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-4ed896ac-ef34-490b-a129-4bb1ea189bbe req-37c7e55d-54e0-4377-bb5e-d0cd08739188 service nova] Creating event network-vif-plugged:717f4f68-10eb-467f-bfc7-a3b1a1bfc78f for instance ea586516-1575-4b69-b10e-b3f281b70c99 on hv-cinder-77398 Feb 21 04:19:39.681830 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-4ed896ac-ef34-490b-a129-4bb1ea189bbe req-37c7e55d-54e0-4377-bb5e-d0cd08739188 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030493 Feb 21 04:19:39.682438 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 414/836] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:19:39.812759 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-fab4a527-c526-4934-8d01-d3537bd10e97 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:39.824408 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fab4a527-c526-4934-8d01-d3537bd10e97 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.170334 Feb 21 04:19:39.825204 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 423/837] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:39 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:39.904363 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-737f6fe8-28b3-422b-8b6d-398bbb6740aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:39.905092 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-737f6fe8-28b3-422b-8b6d-398bbb6740aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:39.912178 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-737f6fe8-28b3-422b-8b6d-398bbb6740aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:39.912652 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-737f6fe8-28b3-422b-8b6d-398bbb6740aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:39.913852 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-737f6fe8-28b3-422b-8b6d-398bbb6740aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:39.914294 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-737f6fe8-28b3-422b-8b6d-398bbb6740aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:40.051423 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-737f6fe8-28b3-422b-8b6d-398bbb6740aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:40.060451 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-737f6fe8-28b3-422b-8b6d-398bbb6740aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:40.062056 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-737f6fe8-28b3-422b-8b6d-398bbb6740aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:40.063343 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-737f6fe8-28b3-422b-8b6d-398bbb6740aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.163722 Feb 21 04:19:40.063936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 415/838] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:39 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:40.658291 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9814e44e-3488-47ef-a156-23484be3a287 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:40.659633 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9814e44e-3488-47ef-a156-23484be3a287 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:40.659763 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7a1b57e8-df2c-4553-b8b3-5abdead824c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:40.660275 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7a1b57e8-df2c-4553-b8b3-5abdead824c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:40.665365 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9814e44e-3488-47ef-a156-23484be3a287 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:40.665808 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9814e44e-3488-47ef-a156-23484be3a287 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:40.666104 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7a1b57e8-df2c-4553-b8b3-5abdead824c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:40.666547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7a1b57e8-df2c-4553-b8b3-5abdead824c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:40.666648 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9814e44e-3488-47ef-a156-23484be3a287 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:40.666991 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9814e44e-3488-47ef-a156-23484be3a287 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:40.667317 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7a1b57e8-df2c-4553-b8b3-5abdead824c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:40.667751 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7a1b57e8-df2c-4553-b8b3-5abdead824c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:40.862576 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7a1b57e8-df2c-4553-b8b3-5abdead824c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:40.865781 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9814e44e-3488-47ef-a156-23484be3a287 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:40.869934 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7a1b57e8-df2c-4553-b8b3-5abdead824c3 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1513 microversion: 2.1 time: 0.214393 Feb 21 04:19:40.870504 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 416/839] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:40 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:40.876717 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9814e44e-3488-47ef-a156-23484be3a287 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1319 microversion: 2.1 time: 0.219111 Feb 21 04:19:40.876717 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 424/840] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:40 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:40.876905 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-22e14594-a360-4794-bd3e-95fa319f8283 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:40.876905 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-22e14594-a360-4794-bd3e-95fa319f8283 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:40.880763 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-22e14594-a360-4794-bd3e-95fa319f8283 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:40.881210 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-22e14594-a360-4794-bd3e-95fa319f8283 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:40.881979 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-22e14594-a360-4794-bd3e-95fa319f8283 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:40.882409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-22e14594-a360-4794-bd3e-95fa319f8283 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:41.016893 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-22e14594-a360-4794-bd3e-95fa319f8283 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:41.024524 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-22e14594-a360-4794-bd3e-95fa319f8283 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.153085 Feb 21 04:19:41.025191 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 417/841] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:40 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:41.083164 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b3841cf1-439f-4126-a053-878e5883409f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:41.083973 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b3841cf1-439f-4126-a053-878e5883409f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:41.090267 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b3841cf1-439f-4126-a053-878e5883409f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:41.090938 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b3841cf1-439f-4126-a053-878e5883409f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:41.091849 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b3841cf1-439f-4126-a053-878e5883409f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:41.092387 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b3841cf1-439f-4126-a053-878e5883409f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:41.234348 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b3841cf1-439f-4126-a053-878e5883409f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:41.242628 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b3841cf1-439f-4126-a053-878e5883409f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:41.244125 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b3841cf1-439f-4126-a053-878e5883409f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:41.245316 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b3841cf1-439f-4126-a053-878e5883409f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.167053 Feb 21 04:19:41.245877 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 425/842] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:41 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:41.697598 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-69b27a1a-89ae-4a7b-ab00-35e81518df4d req-02f5574a-c663-4ecc-b1be-00284e5cf460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6affb217-bc47-45c6-8219-a6b557defb55", "name": "network-vif-plugged", "status": "completed", "tag": "aa7d3525-7090-4e66-8272-2fa8eafeec4d"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:41.699275 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:19:41.699275 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:19:41.706782 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-69b27a1a-89ae-4a7b-ab00-35e81518df4d req-02f5574a-c663-4ecc-b1be-00284e5cf460 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:41.707234 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-69b27a1a-89ae-4a7b-ab00-35e81518df4d req-02f5574a-c663-4ecc-b1be-00284e5cf460 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:41.718728 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-69b27a1a-89ae-4a7b-ab00-35e81518df4d req-02f5574a-c663-4ecc-b1be-00284e5cf460 service nova] Creating event network-vif-plugged:aa7d3525-7090-4e66-8272-2fa8eafeec4d for instance 6affb217-bc47-45c6-8219-a6b557defb55 on hv-cinder-77398 Feb 21 04:19:41.723904 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-69b27a1a-89ae-4a7b-ab00-35e81518df4d req-02f5574a-c663-4ecc-b1be-00284e5cf460 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029879 Feb 21 04:19:41.724497 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 418/843] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:19:41.888314 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4f7bd3bb-79e2-4039-b126-4345863557f8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:41.890102 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4f7bd3bb-79e2-4039-b126-4345863557f8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:41.891176 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7c39daf6-717b-4dac-9e88-e79c9dd8c514 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:41.891964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7c39daf6-717b-4dac-9e88-e79c9dd8c514 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:41.897396 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4f7bd3bb-79e2-4039-b126-4345863557f8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:41.898179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4f7bd3bb-79e2-4039-b126-4345863557f8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:41.899759 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4f7bd3bb-79e2-4039-b126-4345863557f8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:41.900555 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4f7bd3bb-79e2-4039-b126-4345863557f8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:41.917718 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7c39daf6-717b-4dac-9e88-e79c9dd8c514 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:41.918176 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7c39daf6-717b-4dac-9e88-e79c9dd8c514 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:41.918992 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7c39daf6-717b-4dac-9e88-e79c9dd8c514 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:41.919427 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7c39daf6-717b-4dac-9e88-e79c9dd8c514 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:42.397458 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4f7bd3bb-79e2-4039-b126-4345863557f8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:42.406114 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4f7bd3bb-79e2-4039-b126-4345863557f8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1513 microversion: 2.1 time: 0.522996 Feb 21 04:19:42.406835 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7c39daf6-717b-4dac-9e88-e79c9dd8c514 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:42.417579 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 426/844] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:41 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1513 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:42.422824 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fc610f98-353e-4d40-b1a0-1cd1a0af35ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:42.423071 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7c39daf6-717b-4dac-9e88-e79c9dd8c514 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1509 microversion: 2.1 time: 0.537182 Feb 21 04:19:42.423445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fc610f98-353e-4d40-b1a0-1cd1a0af35ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:42.423801 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 419/845] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:41 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1509 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:42.428016 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-83a0b120-800b-45da-97f3-ab7192a57c23 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:42.428620 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-83a0b120-800b-45da-97f3-ab7192a57c23 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:42.440241 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fc610f98-353e-4d40-b1a0-1cd1a0af35ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:42.441025 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fc610f98-353e-4d40-b1a0-1cd1a0af35ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:42.442035 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fc610f98-353e-4d40-b1a0-1cd1a0af35ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:42.442626 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fc610f98-353e-4d40-b1a0-1cd1a0af35ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:42.448614 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-83a0b120-800b-45da-97f3-ab7192a57c23 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:42.449221 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-83a0b120-800b-45da-97f3-ab7192a57c23 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:42.450286 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-83a0b120-800b-45da-97f3-ab7192a57c23 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:42.450941 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-83a0b120-800b-45da-97f3-ab7192a57c23 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:42.766407 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-83a0b120-800b-45da-97f3-ab7192a57c23 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:42.776413 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-83a0b120-800b-45da-97f3-ab7192a57c23 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:42.778274 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-83a0b120-800b-45da-97f3-ab7192a57c23 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:42.779530 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-83a0b120-800b-45da-97f3-ab7192a57c23 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.354767 Feb 21 04:19:42.780109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 420/846] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:42 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:42.782060 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-fc610f98-353e-4d40-b1a0-1cd1a0af35ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:42.784523 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-17aade79-7822-4644-8534-cbb10a182d7e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a69ec720-d55b-4c42-9654-306018dd90ed", "device": "/dev/sdb"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:42.785799 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-17aade79-7822-4644-8534-cbb10a182d7e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:42.791599 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-17aade79-7822-4644-8534-cbb10a182d7e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:42.792046 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-17aade79-7822-4644-8534-cbb10a182d7e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:42.792921 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-17aade79-7822-4644-8534-cbb10a182d7e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:42.793356 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-17aade79-7822-4644-8534-cbb10a182d7e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:42.796026 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fc610f98-353e-4d40-b1a0-1cd1a0af35ed tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.377323 Feb 21 04:19:42.797024 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 427/847] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:42 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:42.801720 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-c18c93e9-9a47-4199-9439-9bb802659df6 req-3925c7a8-b2be-4eda-b892-cb09d6776416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbdc0a4-bc84-45b4-ab5f-5a38689d0b41", "name": "network-vif-deleted", "tag": "81c2bfeb-6e2e-4b6e-a06d-1af7c280bad5"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:42.803336 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:19:42.803336 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:19:42.811655 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-c18c93e9-9a47-4199-9439-9bb802659df6 req-3925c7a8-b2be-4eda-b892-cb09d6776416 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:42.812186 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-c18c93e9-9a47-4199-9439-9bb802659df6 req-3925c7a8-b2be-4eda-b892-cb09d6776416 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:42.823958 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-c18c93e9-9a47-4199-9439-9bb802659df6 req-3925c7a8-b2be-4eda-b892-cb09d6776416 service nova] Creating event network-vif-deleted:81c2bfeb-6e2e-4b6e-a06d-1af7c280bad5 for instance efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 on hv-cinder-77398 Feb 21 04:19:42.828780 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-c18c93e9-9a47-4199-9439-9bb802659df6 req-3925c7a8-b2be-4eda-b892-cb09d6776416 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030260 Feb 21 04:19:42.829697 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 428/848] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:19:43.020855 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-17aade79-7822-4644-8534-cbb10a182d7e tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "POST /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239453 Feb 21 04:19:43.021564 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 421/849] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:19:42 2022] POST /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:19:43.425444 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-eaf82078-3569-48e2-970c-f257749e7eff tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:43.426173 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-eaf82078-3569-48e2-970c-f257749e7eff tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:43.432562 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eaf82078-3569-48e2-970c-f257749e7eff tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:43.433044 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eaf82078-3569-48e2-970c-f257749e7eff tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:43.433809 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eaf82078-3569-48e2-970c-f257749e7eff tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:43.434235 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eaf82078-3569-48e2-970c-f257749e7eff tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:43.462964 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eaf82078-3569-48e2-970c-f257749e7eff tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:43.463407 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eaf82078-3569-48e2-970c-f257749e7eff tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:43.463843 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-eaf82078-3569-48e2-970c-f257749e7eff tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lazy-loading 'fault' on Instance uuid efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:19:43.503643 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-eaf82078-3569-48e2-970c-f257749e7eff tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:43.510762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-eaf82078-3569-48e2-970c-f257749e7eff tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1307 microversion: 2.1 time: 0.089968 Feb 21 04:19:43.511319 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 429/850] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:43 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:43.798148 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d433c74c-5cca-40bc-8214-09102a620955 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:43.798858 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d433c74c-5cca-40bc-8214-09102a620955 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:43.805034 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d433c74c-5cca-40bc-8214-09102a620955 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:43.805475 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d433c74c-5cca-40bc-8214-09102a620955 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:43.806240 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d433c74c-5cca-40bc-8214-09102a620955 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:43.806669 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d433c74c-5cca-40bc-8214-09102a620955 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:43.811740 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-49d864a8-36e5-4dba-9aab-26d30100d84c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:43.812344 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-49d864a8-36e5-4dba-9aab-26d30100d84c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:43.818332 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-49d864a8-36e5-4dba-9aab-26d30100d84c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:43.818781 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-49d864a8-36e5-4dba-9aab-26d30100d84c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:43.819547 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-49d864a8-36e5-4dba-9aab-26d30100d84c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:43.819982 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-49d864a8-36e5-4dba-9aab-26d30100d84c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:44.008907 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d433c74c-5cca-40bc-8214-09102a620955 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:44.015412 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-49d864a8-36e5-4dba-9aab-26d30100d84c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:44.017297 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d433c74c-5cca-40bc-8214-09102a620955 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:44.019348 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d433c74c-5cca-40bc-8214-09102a620955 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:44.020571 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d433c74c-5cca-40bc-8214-09102a620955 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.226914 Feb 21 04:19:44.021236 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 422/851] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:43 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:44.023039 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-49d864a8-36e5-4dba-9aab-26d30100d84c tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.214843 Feb 21 04:19:44.023600 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 430/852] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:43 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:44.527030 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-658d09e2-e3e9-406e-97a9-63adedb6211c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:44.527641 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-658d09e2-e3e9-406e-97a9-63adedb6211c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:44.534128 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-658d09e2-e3e9-406e-97a9-63adedb6211c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:44.534570 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-658d09e2-e3e9-406e-97a9-63adedb6211c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:44.535339 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-658d09e2-e3e9-406e-97a9-63adedb6211c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:44.535771 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-658d09e2-e3e9-406e-97a9-63adedb6211c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:44.566438 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-658d09e2-e3e9-406e-97a9-63adedb6211c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:44.566877 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-658d09e2-e3e9-406e-97a9-63adedb6211c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:44.567314 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-658d09e2-e3e9-406e-97a9-63adedb6211c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lazy-loading 'fault' on Instance uuid efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:19:44.606252 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-658d09e2-e3e9-406e-97a9-63adedb6211c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:44.614464 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-658d09e2-e3e9-406e-97a9-63adedb6211c tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1307 microversion: 2.1 time: 0.090981 Feb 21 04:19:44.615038 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 423/853] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:44 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:45.038961 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-df9cbea9-4549-4557-9554-fe07a1067bb4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:45.039625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-df9cbea9-4549-4557-9554-fe07a1067bb4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:45.040038 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fa4b2d29-b399-4a89-8796-2eaee47feb9d tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:45.040682 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fa4b2d29-b399-4a89-8796-2eaee47feb9d tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:45.046020 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-df9cbea9-4549-4557-9554-fe07a1067bb4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:45.046464 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-df9cbea9-4549-4557-9554-fe07a1067bb4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:45.046799 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fa4b2d29-b399-4a89-8796-2eaee47feb9d tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:45.047237 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-df9cbea9-4549-4557-9554-fe07a1067bb4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:45.047336 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fa4b2d29-b399-4a89-8796-2eaee47feb9d tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:45.047720 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-df9cbea9-4549-4557-9554-fe07a1067bb4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:45.048011 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fa4b2d29-b399-4a89-8796-2eaee47feb9d tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:45.048440 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fa4b2d29-b399-4a89-8796-2eaee47feb9d tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:45.249268 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fa4b2d29-b399-4a89-8796-2eaee47feb9d tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:45.252475 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-df9cbea9-4549-4557-9554-fe07a1067bb4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:45.256399 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fa4b2d29-b399-4a89-8796-2eaee47feb9d tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.219840 Feb 21 04:19:45.256994 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 424/854] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:45 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:45.262157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-df9cbea9-4549-4557-9554-fe07a1067bb4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:45.265300 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-df9cbea9-4549-4557-9554-fe07a1067bb4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:45.267519 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-df9cbea9-4549-4557-9554-fe07a1067bb4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.232043 Feb 21 04:19:45.269097 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 431/855] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:45 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:45.631397 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f266b8db-2661-47b0-9636-06b0a1cc63c8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:45.632007 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f266b8db-2661-47b0-9636-06b0a1cc63c8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:45.637991 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f266b8db-2661-47b0-9636-06b0a1cc63c8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:45.638438 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f266b8db-2661-47b0-9636-06b0a1cc63c8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:45.639219 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f266b8db-2661-47b0-9636-06b0a1cc63c8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:45.639653 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f266b8db-2661-47b0-9636-06b0a1cc63c8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:45.669943 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f266b8db-2661-47b0-9636-06b0a1cc63c8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:45.670390 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f266b8db-2661-47b0-9636-06b0a1cc63c8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:45.670835 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-f266b8db-2661-47b0-9636-06b0a1cc63c8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lazy-loading 'fault' on Instance uuid efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:19:45.710473 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f266b8db-2661-47b0-9636-06b0a1cc63c8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:45.717649 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f266b8db-2661-47b0-9636-06b0a1cc63c8 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1307 microversion: 2.1 time: 0.090616 Feb 21 04:19:45.718225 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 425/856] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:45 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:46.273714 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-cb783554-33fe-44ee-ae1a-0a770892d0a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:46.274315 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-cb783554-33fe-44ee-ae1a-0a770892d0a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:46.280275 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cb783554-33fe-44ee-ae1a-0a770892d0a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:46.280752 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cb783554-33fe-44ee-ae1a-0a770892d0a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:46.281516 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cb783554-33fe-44ee-ae1a-0a770892d0a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:46.281947 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cb783554-33fe-44ee-ae1a-0a770892d0a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:46.289907 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-68104b22-a879-4d3d-8dc2-7ae53358a3d3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:46.290514 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-68104b22-a879-4d3d-8dc2-7ae53358a3d3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:46.297311 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-68104b22-a879-4d3d-8dc2-7ae53358a3d3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:46.297759 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-68104b22-a879-4d3d-8dc2-7ae53358a3d3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:46.298530 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-68104b22-a879-4d3d-8dc2-7ae53358a3d3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:46.298956 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-68104b22-a879-4d3d-8dc2-7ae53358a3d3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:46.477095 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-cb783554-33fe-44ee-ae1a-0a770892d0a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:46.484361 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-cb783554-33fe-44ee-ae1a-0a770892d0a5 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.214361 Feb 21 04:19:46.487432 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 432/857] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:46 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:46.488229 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-68104b22-a879-4d3d-8dc2-7ae53358a3d3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:46.496482 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-68104b22-a879-4d3d-8dc2-7ae53358a3d3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:46.497991 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-68104b22-a879-4d3d-8dc2-7ae53358a3d3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:46.499164 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-68104b22-a879-4d3d-8dc2-7ae53358a3d3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.212914 Feb 21 04:19:46.499715 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 426/858] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:46 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:19:46.734542 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-081cd243-0751-4ae7-aed7-282c4c417ecd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:46.735093 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-081cd243-0751-4ae7-aed7-282c4c417ecd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:46.741016 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-081cd243-0751-4ae7-aed7-282c4c417ecd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:46.741468 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-081cd243-0751-4ae7-aed7-282c4c417ecd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:46.742242 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-081cd243-0751-4ae7-aed7-282c4c417ecd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:46.742676 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-081cd243-0751-4ae7-aed7-282c4c417ecd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:46.772592 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-081cd243-0751-4ae7-aed7-282c4c417ecd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:46.773092 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-081cd243-0751-4ae7-aed7-282c4c417ecd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:46.773535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-081cd243-0751-4ae7-aed7-282c4c417ecd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lazy-loading 'fault' on Instance uuid efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:19:46.813154 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-081cd243-0751-4ae7-aed7-282c4c417ecd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea911774944fa2bdb292719f9e2a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b65910b0574d41970df84e6a1fdbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:46.820177 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-081cd243-0751-4ae7-aed7-282c4c417ecd tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 200 len: 1307 microversion: 2.1 time: 0.089259 Feb 21 04:19:46.820765 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 433/859] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:46 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:47.501554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0b1a8fde-2ee9-4447-b287-162d3632033e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:47.502845 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0b1a8fde-2ee9-4447-b287-162d3632033e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:47.509617 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0b1a8fde-2ee9-4447-b287-162d3632033e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:47.510059 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0b1a8fde-2ee9-4447-b287-162d3632033e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:47.510866 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0b1a8fde-2ee9-4447-b287-162d3632033e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:47.511295 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0b1a8fde-2ee9-4447-b287-162d3632033e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:47.516993 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0883e698-b2c4-4e59-9fa9-2ae3f4f5f9ac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:47.517680 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0883e698-b2c4-4e59-9fa9-2ae3f4f5f9ac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:47.525325 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0883e698-b2c4-4e59-9fa9-2ae3f4f5f9ac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:47.525785 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0883e698-b2c4-4e59-9fa9-2ae3f4f5f9ac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:47.526734 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0883e698-b2c4-4e59-9fa9-2ae3f4f5f9ac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:47.527181 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0883e698-b2c4-4e59-9fa9-2ae3f4f5f9ac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:47.728073 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0b1a8fde-2ee9-4447-b287-162d3632033e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:47.732348 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0883e698-b2c4-4e59-9fa9-2ae3f4f5f9ac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:47.735594 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0b1a8fde-2ee9-4447-b287-162d3632033e tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1314 microversion: 2.1 time: 0.237534 Feb 21 04:19:47.736501 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 427/860] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:47 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:47.741906 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0883e698-b2c4-4e59-9fa9-2ae3f4f5f9ac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:47.743522 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0883e698-b2c4-4e59-9fa9-2ae3f4f5f9ac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:47.744828 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0883e698-b2c4-4e59-9fa9-2ae3f4f5f9ac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.231375 Feb 21 04:19:47.745779 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 434/861] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:47 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:19:47.836552 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-daa64a6e-ea59-4233-bd81-b3811be1a870 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:47.837194 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-daa64a6e-ea59-4233-bd81-b3811be1a870 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] [instance: efbdc0a4-bc84-45b4-ab5f-5a38689d0b41] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:47.842903 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-daa64a6e-ea59-4233-bd81-b3811be1a870 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:47.843342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-daa64a6e-ea59-4233-bd81-b3811be1a870 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:47.844100 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-daa64a6e-ea59-4233-bd81-b3811be1a870 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:47.844526 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-daa64a6e-ea59-4233-bd81-b3811be1a870 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:47.859066 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-daa64a6e-ea59-4233-bd81-b3811be1a870 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] HTTP exception thrown: Instance efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 could not be found. Feb 21 04:19:47.859624 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-daa64a6e-ea59-4233-bd81-b3811be1a870 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] Returning 404 to user: Instance efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:19:47.860409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-daa64a6e-ea59-4233-bd81-b3811be1a870 tempest-AttachVolumeNegativeTest-1696513815 tempest-AttachVolumeNegativeTest-1696513815-project] 10.222.0.10 "GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41" status: 404 len: 111 microversion: 2.1 time: 0.027656 Feb 21 04:19:47.860950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 428/862] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:47 2022] GET /compute/v2.1/servers/efbdc0a4-bc84-45b4-ab5f-5a38689d0b41 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:19:48.753491 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-047b1b8b-11e2-4b1b-a9b9-9ae1654abff2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:48.754085 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-047b1b8b-11e2-4b1b-a9b9-9ae1654abff2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:48.760667 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-047b1b8b-11e2-4b1b-a9b9-9ae1654abff2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:48.761125 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-047b1b8b-11e2-4b1b-a9b9-9ae1654abff2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:48.761913 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-047b1b8b-11e2-4b1b-a9b9-9ae1654abff2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:48.762347 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-047b1b8b-11e2-4b1b-a9b9-9ae1654abff2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:48.763111 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d6ad960d-8d82-465b-9ea3-3cf1ce9f3825 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:48.764440 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d6ad960d-8d82-465b-9ea3-3cf1ce9f3825 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:48.774864 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d6ad960d-8d82-465b-9ea3-3cf1ce9f3825 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:48.775383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d6ad960d-8d82-465b-9ea3-3cf1ce9f3825 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:48.776101 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d6ad960d-8d82-465b-9ea3-3cf1ce9f3825 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:48.776531 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d6ad960d-8d82-465b-9ea3-3cf1ce9f3825 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:49.016385 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-047b1b8b-11e2-4b1b-a9b9-9ae1654abff2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:49.020812 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d6ad960d-8d82-465b-9ea3-3cf1ce9f3825 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:49.024112 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-047b1b8b-11e2-4b1b-a9b9-9ae1654abff2 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1463 microversion: 2.1 time: 0.274822 Feb 21 04:19:49.025056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 435/863] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:48 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1463 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:49.032759 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d6ad960d-8d82-465b-9ea3-3cf1ce9f3825 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:49.034556 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d6ad960d-8d82-465b-9ea3-3cf1ce9f3825 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:49.036012 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d6ad960d-8d82-465b-9ea3-3cf1ce9f3825 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.276756 Feb 21 04:19:49.046749 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 429/864] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:48 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:19:49.063014 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5e99c5e5-65c8-427f-83bc-2f3a7da022af tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:49.063687 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5e99c5e5-65c8-427f-83bc-2f3a7da022af tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:49.070579 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5e99c5e5-65c8-427f-83bc-2f3a7da022af tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:49.071113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5e99c5e5-65c8-427f-83bc-2f3a7da022af tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:49.072040 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5e99c5e5-65c8-427f-83bc-2f3a7da022af tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:49.072758 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5e99c5e5-65c8-427f-83bc-2f3a7da022af tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:49.100014 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5e99c5e5-65c8-427f-83bc-2f3a7da022af tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Going to try to terminate instance {{(pid=116571) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:19:49.177358 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5e99c5e5-65c8-427f-83bc-2f3a7da022af tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "DELETE /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 204 len: 0 microversion: 2.1 time: 0.117461 Feb 21 04:19:49.178367 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 436/865] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:19:49 2022] DELETE /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:19:49.188056 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-efd7b59f-2907-4123-9bb7-235a982b5644 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:49.188802 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-efd7b59f-2907-4123-9bb7-235a982b5644 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:49.195984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-efd7b59f-2907-4123-9bb7-235a982b5644 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:49.196521 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-efd7b59f-2907-4123-9bb7-235a982b5644 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:49.197435 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-efd7b59f-2907-4123-9bb7-235a982b5644 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:49.197975 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-efd7b59f-2907-4123-9bb7-235a982b5644 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:49.337084 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-efd7b59f-2907-4123-9bb7-235a982b5644 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:49.344330 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-efd7b59f-2907-4123-9bb7-235a982b5644 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1469 microversion: 2.1 time: 0.160535 Feb 21 04:19:49.345098 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 430/866] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:49 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:50.054520 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8094a887-f32d-4c7a-bf4a-59c90ff7624b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:50.055325 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-8094a887-f32d-4c7a-bf4a-59c90ff7624b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:50.061645 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8094a887-f32d-4c7a-bf4a-59c90ff7624b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:50.062337 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8094a887-f32d-4c7a-bf4a-59c90ff7624b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:50.063210 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8094a887-f32d-4c7a-bf4a-59c90ff7624b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:50.063736 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8094a887-f32d-4c7a-bf4a-59c90ff7624b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:50.222162 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8094a887-f32d-4c7a-bf4a-59c90ff7624b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:50.230537 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8094a887-f32d-4c7a-bf4a-59c90ff7624b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:50.232024 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8094a887-f32d-4c7a-bf4a-59c90ff7624b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:50.233205 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-8094a887-f32d-4c7a-bf4a-59c90ff7624b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.183118 Feb 21 04:19:50.233759 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 437/867] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:50 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:50.361785 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-22b71cc2-7c67-45bc-9bdc-1d3f6f9d8072 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:50.362493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-22b71cc2-7c67-45bc-9bdc-1d3f6f9d8072 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:50.368991 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-22b71cc2-7c67-45bc-9bdc-1d3f6f9d8072 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:50.369692 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-22b71cc2-7c67-45bc-9bdc-1d3f6f9d8072 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:50.370859 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-22b71cc2-7c67-45bc-9bdc-1d3f6f9d8072 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:50.371438 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-22b71cc2-7c67-45bc-9bdc-1d3f6f9d8072 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:50.518770 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-22b71cc2-7c67-45bc-9bdc-1d3f6f9d8072 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:50.526481 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-22b71cc2-7c67-45bc-9bdc-1d3f6f9d8072 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1469 microversion: 2.1 time: 0.168411 Feb 21 04:19:50.527039 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 431/868] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:50 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:19:51.251270 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-215de713-74cd-4a27-bd43-0d11960337aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:51.251851 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-215de713-74cd-4a27-bd43-0d11960337aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:51.258535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-215de713-74cd-4a27-bd43-0d11960337aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:51.258974 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-215de713-74cd-4a27-bd43-0d11960337aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:51.259742 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-215de713-74cd-4a27-bd43-0d11960337aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:51.260168 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-215de713-74cd-4a27-bd43-0d11960337aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:51.468461 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-431afb3a-fb1d-4832-a7fc-a8f98ea4c68f req-161cd9dc-eac0-4142-98bc-88ee4fc4d22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6affb217-bc47-45c6-8219-a6b557defb55", "name": "network-vif-deleted", "tag": "aa7d3525-7090-4e66-8272-2fa8eafeec4d"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:51.470132 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:19:51.470132 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:19:51.491408 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-431afb3a-fb1d-4832-a7fc-a8f98ea4c68f req-161cd9dc-eac0-4142-98bc-88ee4fc4d22e service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:51.491790 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-431afb3a-fb1d-4832-a7fc-a8f98ea4c68f req-161cd9dc-eac0-4142-98bc-88ee4fc4d22e service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:51.497956 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-215de713-74cd-4a27-bd43-0d11960337aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:51.508038 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-215de713-74cd-4a27-bd43-0d11960337aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:51.509602 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-215de713-74cd-4a27-bd43-0d11960337aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:51.510824 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-215de713-74cd-4a27-bd43-0d11960337aa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.263257 Feb 21 04:19:51.511321 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-431afb3a-fb1d-4832-a7fc-a8f98ea4c68f req-161cd9dc-eac0-4142-98bc-88ee4fc4d22e service nova] Creating event network-vif-deleted:aa7d3525-7090-4e66-8272-2fa8eafeec4d for instance 6affb217-bc47-45c6-8219-a6b557defb55 on hv-cinder-77398 Feb 21 04:19:51.516075 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 438/869] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:51 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:51.527171 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-431afb3a-fb1d-4832-a7fc-a8f98ea4c68f req-161cd9dc-eac0-4142-98bc-88ee4fc4d22e service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063771 Feb 21 04:19:51.528565 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 432/870] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:19:51.556047 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b03ba86a-4ebb-49b5-907d-aae190b8f8f9 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:51.560840 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b03ba86a-4ebb-49b5-907d-aae190b8f8f9 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:51.575162 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b03ba86a-4ebb-49b5-907d-aae190b8f8f9 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:51.576518 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b03ba86a-4ebb-49b5-907d-aae190b8f8f9 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:51.581958 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b03ba86a-4ebb-49b5-907d-aae190b8f8f9 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:51.583163 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b03ba86a-4ebb-49b5-907d-aae190b8f8f9 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:51.740861 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b03ba86a-4ebb-49b5-907d-aae190b8f8f9 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288920ba584f4ec29101638e37e6f9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a283a65347cb40d49115aa80e0927d0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:51.758236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b03ba86a-4ebb-49b5-907d-aae190b8f8f9 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 200 len: 1299 microversion: 2.1 time: 0.215912 Feb 21 04:19:51.759205 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 439/871] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:51 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 1299 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:19:52.530415 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a449f3d2-f8d5-473c-8c0e-a9083a2fadb3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:52.531024 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a449f3d2-f8d5-473c-8c0e-a9083a2fadb3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:52.537343 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a449f3d2-f8d5-473c-8c0e-a9083a2fadb3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:52.537784 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a449f3d2-f8d5-473c-8c0e-a9083a2fadb3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:52.538559 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a449f3d2-f8d5-473c-8c0e-a9083a2fadb3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:52.538991 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a449f3d2-f8d5-473c-8c0e-a9083a2fadb3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:52.671335 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a449f3d2-f8d5-473c-8c0e-a9083a2fadb3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:52.680062 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a449f3d2-f8d5-473c-8c0e-a9083a2fadb3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:52.681550 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a449f3d2-f8d5-473c-8c0e-a9083a2fadb3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:52.682704 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a449f3d2-f8d5-473c-8c0e-a9083a2fadb3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.157135 Feb 21 04:19:52.683262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 433/872] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:52 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:52.791089 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fee944a7-e94e-40db-84fa-fabc895a1420 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:52.791089 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fee944a7-e94e-40db-84fa-fabc895a1420 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] [instance: 6affb217-bc47-45c6-8219-a6b557defb55] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:52.793936 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fee944a7-e94e-40db-84fa-fabc895a1420 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:52.794393 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fee944a7-e94e-40db-84fa-fabc895a1420 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:52.795175 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fee944a7-e94e-40db-84fa-fabc895a1420 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:52.795613 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fee944a7-e94e-40db-84fa-fabc895a1420 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:52.809446 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-fee944a7-e94e-40db-84fa-fabc895a1420 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] HTTP exception thrown: Instance 6affb217-bc47-45c6-8219-a6b557defb55 could not be found. Feb 21 04:19:52.810037 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fee944a7-e94e-40db-84fa-fabc895a1420 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] Returning 404 to user: Instance 6affb217-bc47-45c6-8219-a6b557defb55 could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:19:52.810854 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fee944a7-e94e-40db-84fa-fabc895a1420 tempest-VolumesNegativeTest-1077402896 tempest-VolumesNegativeTest-1077402896-project] 10.222.0.10 "GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55" status: 404 len: 111 microversion: 2.1 time: 0.027550 Feb 21 04:19:52.811384 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 440/873] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:19:52 2022] GET /compute/v2.1/servers/6affb217-bc47-45c6-8219-a6b557defb55 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:19:53.702448 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c6515918-bbfb-44f6-8489-997932e6ebe1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:53.703063 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c6515918-bbfb-44f6-8489-997932e6ebe1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:53.714321 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c6515918-bbfb-44f6-8489-997932e6ebe1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:53.714782 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c6515918-bbfb-44f6-8489-997932e6ebe1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:53.715582 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c6515918-bbfb-44f6-8489-997932e6ebe1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:53.716162 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c6515918-bbfb-44f6-8489-997932e6ebe1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:53.880315 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-7b1e7064-e35e-41f8-9c76-e3a91241cc6c req-940e549a-d624-4955-b545-c248ccc0d143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c59a20-ff75-456f-99b3-070207d951d7", "name": "network-vif-plugged", "status": "completed", "tag": "ad4a893e-bbd1-41d8-a92a-483868402b5b"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:19:53.881922 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:19:53.881922 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:19:53.898572 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-7b1e7064-e35e-41f8-9c76-e3a91241cc6c req-940e549a-d624-4955-b545-c248ccc0d143 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:53.898745 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c6515918-bbfb-44f6-8489-997932e6ebe1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:53.899495 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-7b1e7064-e35e-41f8-9c76-e3a91241cc6c req-940e549a-d624-4955-b545-c248ccc0d143 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:53.908130 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c6515918-bbfb-44f6-8489-997932e6ebe1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:53.909703 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c6515918-bbfb-44f6-8489-997932e6ebe1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:53.911282 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c6515918-bbfb-44f6-8489-997932e6ebe1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.213540 Feb 21 04:19:53.911837 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 434/874] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:53 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:53.927585 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-7b1e7064-e35e-41f8-9c76-e3a91241cc6c req-940e549a-d624-4955-b545-c248ccc0d143 service nova] Creating event network-vif-plugged:ad4a893e-bbd1-41d8-a92a-483868402b5b for instance c0c59a20-ff75-456f-99b3-070207d951d7 on hv-cinder-77398 Feb 21 04:19:53.932402 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-7b1e7064-e35e-41f8-9c76-e3a91241cc6c req-940e549a-d624-4955-b545-c248ccc0d143 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225340 Feb 21 04:19:53.933188 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 441/875] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:19:54.929373 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f1de0fba-94cf-4e5d-8144-0b503c25c5f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:54.930002 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f1de0fba-94cf-4e5d-8144-0b503c25c5f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:54.936284 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f1de0fba-94cf-4e5d-8144-0b503c25c5f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:54.936931 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f1de0fba-94cf-4e5d-8144-0b503c25c5f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:54.937709 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f1de0fba-94cf-4e5d-8144-0b503c25c5f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:54.938135 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f1de0fba-94cf-4e5d-8144-0b503c25c5f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:55.075897 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f1de0fba-94cf-4e5d-8144-0b503c25c5f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:55.084703 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f1de0fba-94cf-4e5d-8144-0b503c25c5f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:55.086280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f1de0fba-94cf-4e5d-8144-0b503c25c5f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:55.087576 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f1de0fba-94cf-4e5d-8144-0b503c25c5f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.161746 Feb 21 04:19:55.088046 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 435/876] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:54 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:56.107141 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-dc44c42f-f96c-4851-b1c1-bc3e7662ac35 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:56.107836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-dc44c42f-f96c-4851-b1c1-bc3e7662ac35 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:56.114597 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc44c42f-f96c-4851-b1c1-bc3e7662ac35 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:56.115044 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc44c42f-f96c-4851-b1c1-bc3e7662ac35 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:56.115822 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc44c42f-f96c-4851-b1c1-bc3e7662ac35 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:56.116254 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc44c42f-f96c-4851-b1c1-bc3e7662ac35 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:56.245583 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dc44c42f-f96c-4851-b1c1-bc3e7662ac35 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:56.253872 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dc44c42f-f96c-4851-b1c1-bc3e7662ac35 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:56.255352 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dc44c42f-f96c-4851-b1c1-bc3e7662ac35 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:56.256520 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-dc44c42f-f96c-4851-b1c1-bc3e7662ac35 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.153897 Feb 21 04:19:56.257141 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 442/877] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:56 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:57.273365 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-84ede3f0-2115-40c0-a064-86c6b4682401 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:57.273975 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-84ede3f0-2115-40c0-a064-86c6b4682401 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:57.280490 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-84ede3f0-2115-40c0-a064-86c6b4682401 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:57.280974 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-84ede3f0-2115-40c0-a064-86c6b4682401 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:57.281751 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-84ede3f0-2115-40c0-a064-86c6b4682401 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:57.282185 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-84ede3f0-2115-40c0-a064-86c6b4682401 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:57.417248 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-84ede3f0-2115-40c0-a064-86c6b4682401 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:57.427688 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-84ede3f0-2115-40c0-a064-86c6b4682401 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:57.429305 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-84ede3f0-2115-40c0-a064-86c6b4682401 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:57.430458 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-84ede3f0-2115-40c0-a064-86c6b4682401 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.160786 Feb 21 04:19:57.431050 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 436/878] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:57 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:58.451251 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b7c2dd38-b9ff-4c81-8157-149702597a77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:58.451251 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b7c2dd38-b9ff-4c81-8157-149702597a77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:58.456534 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b7c2dd38-b9ff-4c81-8157-149702597a77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:58.456999 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b7c2dd38-b9ff-4c81-8157-149702597a77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:58.457767 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b7c2dd38-b9ff-4c81-8157-149702597a77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:58.458199 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b7c2dd38-b9ff-4c81-8157-149702597a77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:58.593029 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b7c2dd38-b9ff-4c81-8157-149702597a77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:58.601430 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b7c2dd38-b9ff-4c81-8157-149702597a77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:58.602893 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b7c2dd38-b9ff-4c81-8157-149702597a77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:58.604055 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b7c2dd38-b9ff-4c81-8157-149702597a77 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.158359 Feb 21 04:19:58.604594 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 443/879] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:58 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:19:59.625337 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b8b9e644-8308-427b-8bb4-64f96c7ec9f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:19:59.626549 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b8b9e644-8308-427b-8bb4-64f96c7ec9f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:19:59.634032 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8b9e644-8308-427b-8bb4-64f96c7ec9f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:59.634129 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8b9e644-8308-427b-8bb4-64f96c7ec9f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:59.634848 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8b9e644-8308-427b-8bb4-64f96c7ec9f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:19:59.635464 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8b9e644-8308-427b-8bb4-64f96c7ec9f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:19:59.792214 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b8b9e644-8308-427b-8bb4-64f96c7ec9f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:59.802402 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b8b9e644-8308-427b-8bb4-64f96c7ec9f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:59.803987 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b8b9e644-8308-427b-8bb4-64f96c7ec9f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:19:59.805267 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b8b9e644-8308-427b-8bb4-64f96c7ec9f9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.186931 Feb 21 04:19:59.816752 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 437/880] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:19:59 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:20:00.823026 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-eea007e6-8968-4742-9db3-905b897db135 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:00.823625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-eea007e6-8968-4742-9db3-905b897db135 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:00.830101 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eea007e6-8968-4742-9db3-905b897db135 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:00.840602 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eea007e6-8968-4742-9db3-905b897db135 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:00.843744 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eea007e6-8968-4742-9db3-905b897db135 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:00.844321 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eea007e6-8968-4742-9db3-905b897db135 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:00.996294 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-eea007e6-8968-4742-9db3-905b897db135 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:01.004925 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-eea007e6-8968-4742-9db3-905b897db135 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:01.006448 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-eea007e6-8968-4742-9db3-905b897db135 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:01.007614 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-eea007e6-8968-4742-9db3-905b897db135 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1810 microversion: 2.20 time: 0.188226 Feb 21 04:20:01.008202 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 444/881] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:20:00 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:20:02.025803 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fe20d7fb-8458-415a-bc90-3d41b861f39e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:02.026395 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fe20d7fb-8458-415a-bc90-3d41b861f39e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:02.032871 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fe20d7fb-8458-415a-bc90-3d41b861f39e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:02.033800 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fe20d7fb-8458-415a-bc90-3d41b861f39e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:02.034563 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fe20d7fb-8458-415a-bc90-3d41b861f39e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:02.034990 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fe20d7fb-8458-415a-bc90-3d41b861f39e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:02.164247 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fe20d7fb-8458-415a-bc90-3d41b861f39e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:02.172293 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fe20d7fb-8458-415a-bc90-3d41b861f39e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:02.174478 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fe20d7fb-8458-415a-bc90-3d41b861f39e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:02.175618 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fe20d7fb-8458-415a-bc90-3d41b861f39e tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1797 microversion: 2.20 time: 0.153630 Feb 21 04:20:02.176169 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 438/882] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:20:02 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1797 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:20:25.437677 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fd74b64f-a31a-490a-af0d-0aa0ec73ad54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:20:25.438619 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fd74b64f-a31a-490a-af0d-0aa0ec73ad54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:25.444688 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fd74b64f-a31a-490a-af0d-0aa0ec73ad54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:25.445143 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fd74b64f-a31a-490a-af0d-0aa0ec73ad54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:25.445949 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fd74b64f-a31a-490a-af0d-0aa0ec73ad54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:25.446388 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fd74b64f-a31a-490a-af0d-0aa0ec73ad54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:25.518123 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fd74b64f-a31a-490a-af0d-0aa0ec73ad54 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "POST /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/action" status: 202 len: 0 microversion: 2.1 time: 0.083903 Feb 21 04:20:25.521638 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 445/883] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:20:25 2022] POST /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 04:20:25.526791 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7c028f5b-e912-4a3b-b9e8-cc1c3ef6ef07 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:25.527467 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7c028f5b-e912-4a3b-b9e8-cc1c3ef6ef07 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:25.533748 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7c028f5b-e912-4a3b-b9e8-cc1c3ef6ef07 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:25.534188 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7c028f5b-e912-4a3b-b9e8-cc1c3ef6ef07 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:25.535467 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7c028f5b-e912-4a3b-b9e8-cc1c3ef6ef07 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:25.536332 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7c028f5b-e912-4a3b-b9e8-cc1c3ef6ef07 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:25.781002 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7c028f5b-e912-4a3b-b9e8-cc1c3ef6ef07 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:25.789297 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7c028f5b-e912-4a3b-b9e8-cc1c3ef6ef07 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1752 microversion: 2.1 time: 0.266413 Feb 21 04:20:25.790064 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 439/884] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:25 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1752 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:26.808025 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-990106f6-7e21-476d-a7b0-35a0e7f636fd tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:26.808715 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-990106f6-7e21-476d-a7b0-35a0e7f636fd tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:26.814844 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-990106f6-7e21-476d-a7b0-35a0e7f636fd tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:26.815289 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-990106f6-7e21-476d-a7b0-35a0e7f636fd tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:26.816418 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-990106f6-7e21-476d-a7b0-35a0e7f636fd tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:26.816885 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-990106f6-7e21-476d-a7b0-35a0e7f636fd tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:26.964225 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-990106f6-7e21-476d-a7b0-35a0e7f636fd tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:26.972467 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-990106f6-7e21-476d-a7b0-35a0e7f636fd tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.168553 Feb 21 04:20:26.973080 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 446/885] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:26 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:27.990134 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3c003c36-e334-41ac-96fe-b468cf42b60d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:27.990669 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3c003c36-e334-41ac-96fe-b468cf42b60d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:27.996854 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3c003c36-e334-41ac-96fe-b468cf42b60d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:27.997296 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3c003c36-e334-41ac-96fe-b468cf42b60d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:27.998058 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3c003c36-e334-41ac-96fe-b468cf42b60d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:27.998489 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3c003c36-e334-41ac-96fe-b468cf42b60d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:28.143455 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3c003c36-e334-41ac-96fe-b468cf42b60d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:28.153822 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3c003c36-e334-41ac-96fe-b468cf42b60d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.167777 Feb 21 04:20:28.154399 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 440/886] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:27 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:28.167448 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7f5f198b-1f3b-4dab-bf39-5b067c57be4f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:28.167973 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7f5f198b-1f3b-4dab-bf39-5b067c57be4f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:28.174162 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7f5f198b-1f3b-4dab-bf39-5b067c57be4f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:28.174640 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7f5f198b-1f3b-4dab-bf39-5b067c57be4f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:28.175904 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7f5f198b-1f3b-4dab-bf39-5b067c57be4f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:28.176337 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7f5f198b-1f3b-4dab-bf39-5b067c57be4f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:28.251393 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-7f5f198b-1f3b-4dab-bf39-5b067c57be4f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lazy-loading 'services' on Instance uuid ea586516-1575-4b69-b10e-b3f281b70c99 {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:20:28.318576 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7f5f198b-1f3b-4dab-bf39-5b067c57be4f tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "DELETE /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99/os-volume_attachments/a69ec720-d55b-4c42-9654-306018dd90ed" status: 202 len: 0 microversion: 2.1 time: 0.154740 Feb 21 04:20:28.319176 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 447/887] 10.222.0.10 () {58 vars in 1415 bytes} [Mon Feb 21 04:20:28 2022] DELETE /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99/os-volume_attachments/a69ec720-d55b-4c42-9654-306018dd90ed => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:20:29.170749 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a3abf170-e7f0-43b3-8539-2a6bc121bc1a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:29.171940 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a3abf170-e7f0-43b3-8539-2a6bc121bc1a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:29.178711 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a3abf170-e7f0-43b3-8539-2a6bc121bc1a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:29.179166 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a3abf170-e7f0-43b3-8539-2a6bc121bc1a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:29.179999 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a3abf170-e7f0-43b3-8539-2a6bc121bc1a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:29.180436 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a3abf170-e7f0-43b3-8539-2a6bc121bc1a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:29.436910 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-088ff886-9ff1-406e-a47c-9723c20afac0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:29.438252 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-088ff886-9ff1-406e-a47c-9723c20afac0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:29.446025 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-088ff886-9ff1-406e-a47c-9723c20afac0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:29.446921 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-088ff886-9ff1-406e-a47c-9723c20afac0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:29.447934 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-088ff886-9ff1-406e-a47c-9723c20afac0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:29.448860 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-088ff886-9ff1-406e-a47c-9723c20afac0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:29.449714 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a3abf170-e7f0-43b3-8539-2a6bc121bc1a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:29.463296 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a3abf170-e7f0-43b3-8539-2a6bc121bc1a tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.296018 Feb 21 04:20:29.464105 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 441/888] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:29 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:29.496593 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-088ff886-9ff1-406e-a47c-9723c20afac0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Going to try to terminate instance {{(pid=116571) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:20:29.576600 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-088ff886-9ff1-406e-a47c-9723c20afac0 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "DELETE /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 204 len: 0 microversion: 2.1 time: 0.143412 Feb 21 04:20:29.577153 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 448/889] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:20:29 2022] DELETE /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:20:29.585724 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b8c25c51-7af0-4e2a-b835-4cb8b84f3ebe tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:29.586344 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b8c25c51-7af0-4e2a-b835-4cb8b84f3ebe tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:29.594811 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8c25c51-7af0-4e2a-b835-4cb8b84f3ebe tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:29.595245 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8c25c51-7af0-4e2a-b835-4cb8b84f3ebe tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:29.596039 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8c25c51-7af0-4e2a-b835-4cb8b84f3ebe tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:29.596510 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8c25c51-7af0-4e2a-b835-4cb8b84f3ebe tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:29.925302 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b8c25c51-7af0-4e2a-b835-4cb8b84f3ebe tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:29.932479 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b8c25c51-7af0-4e2a-b835-4cb8b84f3ebe tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1515 microversion: 2.1 time: 0.350649 Feb 21 04:20:29.933085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 442/890] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:29 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1515 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:30.487186 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-697ed627-7d2d-4124-b27f-7599136f5721 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:30.488550 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-697ed627-7d2d-4124-b27f-7599136f5721 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:30.494765 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-697ed627-7d2d-4124-b27f-7599136f5721 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:30.495238 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-697ed627-7d2d-4124-b27f-7599136f5721 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:30.496021 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-697ed627-7d2d-4124-b27f-7599136f5721 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:30.496460 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-697ed627-7d2d-4124-b27f-7599136f5721 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:30.674201 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-697ed627-7d2d-4124-b27f-7599136f5721 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:30.683079 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-697ed627-7d2d-4124-b27f-7599136f5721 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.199868 Feb 21 04:20:30.683662 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 449/891] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:30 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:30.949312 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d18076d1-dee2-4ec8-a954-f17565866fa6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:30.950438 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d18076d1-dee2-4ec8-a954-f17565866fa6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:30.957357 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d18076d1-dee2-4ec8-a954-f17565866fa6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:30.957798 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d18076d1-dee2-4ec8-a954-f17565866fa6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:30.958572 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d18076d1-dee2-4ec8-a954-f17565866fa6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:30.959001 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d18076d1-dee2-4ec8-a954-f17565866fa6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:31.146892 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d18076d1-dee2-4ec8-a954-f17565866fa6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:31.156526 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d18076d1-dee2-4ec8-a954-f17565866fa6 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1515 microversion: 2.1 time: 0.210830 Feb 21 04:20:31.157262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 443/892] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:30 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:31.699966 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7a8b1451-db25-43bc-92da-17efa6000e24 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:31.701216 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7a8b1451-db25-43bc-92da-17efa6000e24 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:31.711111 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7a8b1451-db25-43bc-92da-17efa6000e24 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:31.711785 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7a8b1451-db25-43bc-92da-17efa6000e24 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:31.712889 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7a8b1451-db25-43bc-92da-17efa6000e24 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:31.713227 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7a8b1451-db25-43bc-92da-17efa6000e24 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:31.876943 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7a8b1451-db25-43bc-92da-17efa6000e24 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:31.887165 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7a8b1451-db25-43bc-92da-17efa6000e24 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.190735 Feb 21 04:20:31.888406 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 450/893] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:31 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:32.173010 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-088f1dce-d528-45db-9f8c-6aa3c7acf85c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:32.173629 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-088f1dce-d528-45db-9f8c-6aa3c7acf85c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:32.180526 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-088f1dce-d528-45db-9f8c-6aa3c7acf85c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:32.181015 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-088f1dce-d528-45db-9f8c-6aa3c7acf85c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:32.181803 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-088f1dce-d528-45db-9f8c-6aa3c7acf85c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:32.182236 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-088f1dce-d528-45db-9f8c-6aa3c7acf85c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:32.317050 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-088f1dce-d528-45db-9f8c-6aa3c7acf85c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:32.324651 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-088f1dce-d528-45db-9f8c-6aa3c7acf85c tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1515 microversion: 2.1 time: 0.155257 Feb 21 04:20:32.325241 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 444/894] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:32 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:32.898927 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-de9d302c-9260-4e88-b0f9-e757efc5b810 req-52dd727a-11b8-4fcd-a16e-25ac79a4ec0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea586516-1575-4b69-b10e-b3f281b70c99", "name": "network-vif-deleted", "tag": "717f4f68-10eb-467f-bfc7-a3b1a1bfc78f"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:20:32.901451 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:20:32.901451 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:20:32.907363 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c11810e7-bdaa-425e-8b12-e7723f924fe0 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:32.908059 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c11810e7-bdaa-425e-8b12-e7723f924fe0 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:32.912463 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-de9d302c-9260-4e88-b0f9-e757efc5b810 req-52dd727a-11b8-4fcd-a16e-25ac79a4ec0f service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:32.913141 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-de9d302c-9260-4e88-b0f9-e757efc5b810 req-52dd727a-11b8-4fcd-a16e-25ac79a4ec0f service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:32.916851 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c11810e7-bdaa-425e-8b12-e7723f924fe0 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:32.917557 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c11810e7-bdaa-425e-8b12-e7723f924fe0 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:32.918616 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c11810e7-bdaa-425e-8b12-e7723f924fe0 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:32.919125 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c11810e7-bdaa-425e-8b12-e7723f924fe0 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:32.927528 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-de9d302c-9260-4e88-b0f9-e757efc5b810 req-52dd727a-11b8-4fcd-a16e-25ac79a4ec0f service nova] Creating event network-vif-deleted:717f4f68-10eb-467f-bfc7-a3b1a1bfc78f for instance ea586516-1575-4b69-b10e-b3f281b70c99 on hv-cinder-77398 Feb 21 04:20:32.933216 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-de9d302c-9260-4e88-b0f9-e757efc5b810 req-52dd727a-11b8-4fcd-a16e-25ac79a4ec0f service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037908 Feb 21 04:20:32.934089 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 451/895] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:20:33.119613 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c11810e7-bdaa-425e-8b12-e7723f924fe0 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:33.127531 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c11810e7-bdaa-425e-8b12-e7723f924fe0 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.225608 Feb 21 04:20:33.128824 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 445/896] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:32 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:33.344426 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a94038f1-4b55-40e0-b9fd-a3f3e877eeb4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:33.345173 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a94038f1-4b55-40e0-b9fd-a3f3e877eeb4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:33.351927 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a94038f1-4b55-40e0-b9fd-a3f3e877eeb4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:33.352724 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a94038f1-4b55-40e0-b9fd-a3f3e877eeb4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:33.353862 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a94038f1-4b55-40e0-b9fd-a3f3e877eeb4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:33.354360 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a94038f1-4b55-40e0-b9fd-a3f3e877eeb4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:33.389832 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a94038f1-4b55-40e0-b9fd-a3f3e877eeb4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:33.390320 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a94038f1-4b55-40e0-b9fd-a3f3e877eeb4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:33.390815 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-a94038f1-4b55-40e0-b9fd-a3f3e877eeb4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lazy-loading 'fault' on Instance uuid ea586516-1575-4b69-b10e-b3f281b70c99 {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:20:33.448234 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a94038f1-4b55-40e0-b9fd-a3f3e877eeb4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fe3cf35ac441e6b17bf8d52298f883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22350c00f594a80bdd31d6352b095e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:33.454992 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a94038f1-4b55-40e0-b9fd-a3f3e877eeb4 tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 200 len: 1309 microversion: 2.1 time: 0.116323 Feb 21 04:20:33.455568 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 452/897] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:33 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:34.145152 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fbe99571-f490-43c1-b5af-b339ce604898 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:34.145894 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fbe99571-f490-43c1-b5af-b339ce604898 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:34.152095 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fbe99571-f490-43c1-b5af-b339ce604898 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:34.152546 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fbe99571-f490-43c1-b5af-b339ce604898 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:34.153617 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fbe99571-f490-43c1-b5af-b339ce604898 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:34.154053 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fbe99571-f490-43c1-b5af-b339ce604898 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:34.305943 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fbe99571-f490-43c1-b5af-b339ce604898 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:34.313948 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fbe99571-f490-43c1-b5af-b339ce604898 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.173118 Feb 21 04:20:34.314520 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 446/898] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:34 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:34.471141 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f0baec0b-e905-419a-ba00-21d20fc81e5b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:34.471927 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f0baec0b-e905-419a-ba00-21d20fc81e5b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] [instance: ea586516-1575-4b69-b10e-b3f281b70c99] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:34.479253 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f0baec0b-e905-419a-ba00-21d20fc81e5b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:34.479696 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f0baec0b-e905-419a-ba00-21d20fc81e5b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:34.480599 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f0baec0b-e905-419a-ba00-21d20fc81e5b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:34.481058 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f0baec0b-e905-419a-ba00-21d20fc81e5b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:34.494174 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-f0baec0b-e905-419a-ba00-21d20fc81e5b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] HTTP exception thrown: Instance ea586516-1575-4b69-b10e-b3f281b70c99 could not be found. Feb 21 04:20:34.494761 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f0baec0b-e905-419a-ba00-21d20fc81e5b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] Returning 404 to user: Instance ea586516-1575-4b69-b10e-b3f281b70c99 could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:20:34.495574 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f0baec0b-e905-419a-ba00-21d20fc81e5b tempest-VolumesSnapshotTestJSON-1328570883 tempest-VolumesSnapshotTestJSON-1328570883-project] 10.222.0.10 "GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99" status: 404 len: 111 microversion: 2.1 time: 0.028292 Feb 21 04:20:34.496109 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 453/899] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:34 2022] GET /compute/v2.1/servers/ea586516-1575-4b69-b10e-b3f281b70c99 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:20:35.333206 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fdc155ab-e49c-430d-bcaf-45b1625b465f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:35.333812 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fdc155ab-e49c-430d-bcaf-45b1625b465f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:35.339817 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fdc155ab-e49c-430d-bcaf-45b1625b465f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:35.340256 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fdc155ab-e49c-430d-bcaf-45b1625b465f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:35.341054 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fdc155ab-e49c-430d-bcaf-45b1625b465f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:35.341477 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fdc155ab-e49c-430d-bcaf-45b1625b465f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:35.486831 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fdc155ab-e49c-430d-bcaf-45b1625b465f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:35.494507 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fdc155ab-e49c-430d-bcaf-45b1625b465f tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.165617 Feb 21 04:20:35.497376 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 447/900] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:35 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:36.510955 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6ab8d55f-42c1-47b6-b204-fc99b541234c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:36.511567 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6ab8d55f-42c1-47b6-b204-fc99b541234c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:36.517927 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6ab8d55f-42c1-47b6-b204-fc99b541234c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:36.518419 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6ab8d55f-42c1-47b6-b204-fc99b541234c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:36.519198 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6ab8d55f-42c1-47b6-b204-fc99b541234c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:36.519640 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6ab8d55f-42c1-47b6-b204-fc99b541234c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:36.671042 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6ab8d55f-42c1-47b6-b204-fc99b541234c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:36.679897 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6ab8d55f-42c1-47b6-b204-fc99b541234c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.172509 Feb 21 04:20:36.680505 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 454/901] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:36 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:37.697104 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c9b8306d-da34-4eab-8cda-928a7ee866c3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:37.698247 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c9b8306d-da34-4eab-8cda-928a7ee866c3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:37.704473 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c9b8306d-da34-4eab-8cda-928a7ee866c3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:37.704945 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c9b8306d-da34-4eab-8cda-928a7ee866c3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:37.705892 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c9b8306d-da34-4eab-8cda-928a7ee866c3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:37.706323 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c9b8306d-da34-4eab-8cda-928a7ee866c3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:37.864962 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c9b8306d-da34-4eab-8cda-928a7ee866c3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:37.872613 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c9b8306d-da34-4eab-8cda-928a7ee866c3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.179094 Feb 21 04:20:37.873198 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 448/902] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:37 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:38.889453 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a6edf375-3a5e-4bd4-afd5-17de0f607e92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:38.890061 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a6edf375-3a5e-4bd4-afd5-17de0f607e92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:38.896240 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6edf375-3a5e-4bd4-afd5-17de0f607e92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:38.896723 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6edf375-3a5e-4bd4-afd5-17de0f607e92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:38.897500 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6edf375-3a5e-4bd4-afd5-17de0f607e92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:38.897935 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6edf375-3a5e-4bd4-afd5-17de0f607e92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:39.039101 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a6edf375-3a5e-4bd4-afd5-17de0f607e92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:39.046695 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a6edf375-3a5e-4bd4-afd5-17de0f607e92 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.160890 Feb 21 04:20:39.047249 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 455/903] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:38 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:40.064106 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b6b102bb-1813-4170-9e4a-5f56b69af03e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:40.064658 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b6b102bb-1813-4170-9e4a-5f56b69af03e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:40.071591 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b6b102bb-1813-4170-9e4a-5f56b69af03e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:40.072032 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b6b102bb-1813-4170-9e4a-5f56b69af03e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:40.072833 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b6b102bb-1813-4170-9e4a-5f56b69af03e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:40.073264 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b6b102bb-1813-4170-9e4a-5f56b69af03e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:40.215581 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b6b102bb-1813-4170-9e4a-5f56b69af03e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:40.224772 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b6b102bb-1813-4170-9e4a-5f56b69af03e tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.164296 Feb 21 04:20:40.225348 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 449/904] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:40 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:20:41.241918 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-56c74f95-967d-4666-8701-fc70a848ff36 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:41.242528 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-56c74f95-967d-4666-8701-fc70a848ff36 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:41.248708 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-56c74f95-967d-4666-8701-fc70a848ff36 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:41.249159 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-56c74f95-967d-4666-8701-fc70a848ff36 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:41.249926 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-56c74f95-967d-4666-8701-fc70a848ff36 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:41.250357 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-56c74f95-967d-4666-8701-fc70a848ff36 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:41.399760 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-56c74f95-967d-4666-8701-fc70a848ff36 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:41.407678 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-56c74f95-967d-4666-8701-fc70a848ff36 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1757 microversion: 2.1 time: 0.169314 Feb 21 04:20:41.408236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 456/905] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:41 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:20:42.428400 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-bb8bcc14-ac1e-4ed6-b20d-f42b0235ae41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:20:42.429686 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-bb8bcc14-ac1e-4ed6-b20d-f42b0235ae41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:20:42.436527 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bb8bcc14-ac1e-4ed6-b20d-f42b0235ae41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:42.437110 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bb8bcc14-ac1e-4ed6-b20d-f42b0235ae41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:42.437942 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bb8bcc14-ac1e-4ed6-b20d-f42b0235ae41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:20:42.438363 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bb8bcc14-ac1e-4ed6-b20d-f42b0235ae41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:20:42.615822 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-bb8bcc14-ac1e-4ed6-b20d-f42b0235ae41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:20:42.623658 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-bb8bcc14-ac1e-4ed6-b20d-f42b0235ae41 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1760 microversion: 2.1 time: 0.201987 Feb 21 04:20:42.624454 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 450/906] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:20:42 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1760 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:21:35.400576 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7de12815-a99d-423d-9011-0b85d5e7efcc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:35.401221 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7de12815-a99d-423d-9011-0b85d5e7efcc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:35.407219 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7de12815-a99d-423d-9011-0b85d5e7efcc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:35.407670 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7de12815-a99d-423d-9011-0b85d5e7efcc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:35.408446 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7de12815-a99d-423d-9011-0b85d5e7efcc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:35.408912 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7de12815-a99d-423d-9011-0b85d5e7efcc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:35.437348 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7de12815-a99d-423d-9011-0b85d5e7efcc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/os-volume_attachments/555a337d-36ca-4058-bf72-0989de17dfc0" status: 200 len: 194 microversion: 2.20 time: 0.040739 Feb 21 04:21:35.437904 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 457/907] 10.222.0.10 () {60 vars in 1453 bytes} [Mon Feb 21 04:21:35 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/os-volume_attachments/555a337d-36ca-4058-bf72-0989de17dfc0 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:21:35.495623 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e5b37c6f-6e63-4f88-9bed-04a6a814f789 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:35.496165 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e5b37c6f-6e63-4f88-9bed-04a6a814f789 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:35.501960 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e5b37c6f-6e63-4f88-9bed-04a6a814f789 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:35.502399 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e5b37c6f-6e63-4f88-9bed-04a6a814f789 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:35.503158 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e5b37c6f-6e63-4f88-9bed-04a6a814f789 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:35.503588 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e5b37c6f-6e63-4f88-9bed-04a6a814f789 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:35.578093 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-e5b37c6f-6e63-4f88-9bed-04a6a814f789 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lazy-loading 'services' on Instance uuid c0c59a20-ff75-456f-99b3-070207d951d7 {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:21:35.647348 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e5b37c6f-6e63-4f88-9bed-04a6a814f789 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "DELETE /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/os-volume_attachments/555a337d-36ca-4058-bf72-0989de17dfc0" status: 202 len: 0 microversion: 2.20 time: 0.154407 Feb 21 04:21:35.647941 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 451/908] 10.222.0.10 () {60 vars in 1456 bytes} [Mon Feb 21 04:21:35 2022] DELETE /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/os-volume_attachments/555a337d-36ca-4058-bf72-0989de17dfc0 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:21:35.656419 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b4fb45ce-cd1f-47df-bee8-1c0a8824ed28 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:35.657412 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b4fb45ce-cd1f-47df-bee8-1c0a8824ed28 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:35.663925 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b4fb45ce-cd1f-47df-bee8-1c0a8824ed28 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:35.664417 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b4fb45ce-cd1f-47df-bee8-1c0a8824ed28 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:35.665415 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b4fb45ce-cd1f-47df-bee8-1c0a8824ed28 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:35.665850 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b4fb45ce-cd1f-47df-bee8-1c0a8824ed28 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:35.695451 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b4fb45ce-cd1f-47df-bee8-1c0a8824ed28 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043094 Feb 21 04:21:35.696004 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 458/909] 10.222.0.10 () {60 vars in 1342 bytes} [Mon Feb 21 04:21:35 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:21:36.708295 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8b689a4a-a99f-4f0c-9004-96025d328711 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:36.709365 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8b689a4a-a99f-4f0c-9004-96025d328711 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:36.715425 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8b689a4a-a99f-4f0c-9004-96025d328711 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:36.715866 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8b689a4a-a99f-4f0c-9004-96025d328711 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:36.716623 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8b689a4a-a99f-4f0c-9004-96025d328711 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:36.717070 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8b689a4a-a99f-4f0c-9004-96025d328711 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:36.744695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8b689a4a-a99f-4f0c-9004-96025d328711 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041303 Feb 21 04:21:36.745254 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 452/910] 10.222.0.10 () {60 vars in 1342 bytes} [Mon Feb 21 04:21:36 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:21:36.799421 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6b70bfb7-14ca-4e52-ac9c-ca40152204a6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:36.799896 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6b70bfb7-14ca-4e52-ac9c-ca40152204a6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:36.806647 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6b70bfb7-14ca-4e52-ac9c-ca40152204a6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:36.807087 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6b70bfb7-14ca-4e52-ac9c-ca40152204a6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:36.807852 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6b70bfb7-14ca-4e52-ac9c-ca40152204a6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:36.808282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6b70bfb7-14ca-4e52-ac9c-ca40152204a6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:36.831649 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6b70bfb7-14ca-4e52-ac9c-ca40152204a6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Going to try to terminate instance {{(pid=116571) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:21:36.902049 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6b70bfb7-14ca-4e52-ac9c-ca40152204a6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "DELETE /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 204 len: 0 microversion: 2.20 time: 0.105873 Feb 21 04:21:36.902624 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 459/911] 10.222.0.10 () {60 vars in 1279 bytes} [Mon Feb 21 04:21:36 2022] DELETE /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 04:21:36.912507 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-76c5bb51-dbc2-47cd-b5be-e4b3eef39118 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:36.913145 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-76c5bb51-dbc2-47cd-b5be-e4b3eef39118 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:36.918919 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-76c5bb51-dbc2-47cd-b5be-e4b3eef39118 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:36.919356 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-76c5bb51-dbc2-47cd-b5be-e4b3eef39118 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:36.920118 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-76c5bb51-dbc2-47cd-b5be-e4b3eef39118 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:36.920545 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-76c5bb51-dbc2-47cd-b5be-e4b3eef39118 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:37.063287 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-76c5bb51-dbc2-47cd-b5be-e4b3eef39118 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:37.070864 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-76c5bb51-dbc2-47cd-b5be-e4b3eef39118 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:37.072340 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-76c5bb51-dbc2-47cd-b5be-e4b3eef39118 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:37.073511 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-76c5bb51-dbc2-47cd-b5be-e4b3eef39118 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.165646 Feb 21 04:21:37.074067 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 453/912] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:36 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:38.093573 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-668025ed-a42c-40b5-937c-7ae78dc65ee5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:38.094179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-668025ed-a42c-40b5-937c-7ae78dc65ee5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:38.100431 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-668025ed-a42c-40b5-937c-7ae78dc65ee5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:38.100905 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-668025ed-a42c-40b5-937c-7ae78dc65ee5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:38.101671 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-668025ed-a42c-40b5-937c-7ae78dc65ee5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:38.102096 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-668025ed-a42c-40b5-937c-7ae78dc65ee5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:38.233341 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-668025ed-a42c-40b5-937c-7ae78dc65ee5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:38.240993 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-668025ed-a42c-40b5-937c-7ae78dc65ee5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:38.242496 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-668025ed-a42c-40b5-937c-7ae78dc65ee5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:38.243652 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-668025ed-a42c-40b5-937c-7ae78dc65ee5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.154238 Feb 21 04:21:38.244208 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 460/913] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:38 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:39.261964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b7de0f71-0e2c-42fe-b74b-da43526e2506 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:39.262677 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b7de0f71-0e2c-42fe-b74b-da43526e2506 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:39.269144 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b7de0f71-0e2c-42fe-b74b-da43526e2506 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:39.270121 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b7de0f71-0e2c-42fe-b74b-da43526e2506 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:39.270884 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b7de0f71-0e2c-42fe-b74b-da43526e2506 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:39.271357 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b7de0f71-0e2c-42fe-b74b-da43526e2506 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:39.516839 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b7de0f71-0e2c-42fe-b74b-da43526e2506 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:39.525256 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b7de0f71-0e2c-42fe-b74b-da43526e2506 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:39.526683 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b7de0f71-0e2c-42fe-b74b-da43526e2506 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:39.528088 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b7de0f71-0e2c-42fe-b74b-da43526e2506 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 200 len: 1725 microversion: 2.20 time: 0.269560 Feb 21 04:21:39.528683 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 454/914] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:39 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 1725 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:39.961518 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-f5a113ea-cf3b-4d9e-a51f-3ad7641bf06e req-89c6f202-fe11-45d1-b24c-881242912102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c59a20-ff75-456f-99b3-070207d951d7", "name": "network-vif-deleted", "tag": "ad4a893e-bbd1-41d8-a92a-483868402b5b"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:21:39.963107 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:21:39.963107 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:21:39.970620 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-f5a113ea-cf3b-4d9e-a51f-3ad7641bf06e req-89c6f202-fe11-45d1-b24c-881242912102 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:39.971052 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-f5a113ea-cf3b-4d9e-a51f-3ad7641bf06e req-89c6f202-fe11-45d1-b24c-881242912102 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:39.988983 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-f5a113ea-cf3b-4d9e-a51f-3ad7641bf06e req-89c6f202-fe11-45d1-b24c-881242912102 service nova] Creating event network-vif-deleted:ad4a893e-bbd1-41d8-a92a-483868402b5b for instance c0c59a20-ff75-456f-99b3-070207d951d7 on hv-cinder-77398 Feb 21 04:21:39.993952 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-f5a113ea-cf3b-4d9e-a51f-3ad7641bf06e req-89c6f202-fe11-45d1-b24c-881242912102 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035970 Feb 21 04:21:39.994713 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 461/915] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:21:40.546315 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-eeb95799-3203-470c-ada4-51a127ac77f0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:40.546876 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-eeb95799-3203-470c-ada4-51a127ac77f0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:40.553689 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-eeb95799-3203-470c-ada4-51a127ac77f0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:40.554312 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-eeb95799-3203-470c-ada4-51a127ac77f0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:40.555085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-eeb95799-3203-470c-ada4-51a127ac77f0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:40.555518 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-eeb95799-3203-470c-ada4-51a127ac77f0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:40.568932 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-eeb95799-3203-470c-ada4-51a127ac77f0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] HTTP exception thrown: Instance c0c59a20-ff75-456f-99b3-070207d951d7 could not be found. Feb 21 04:21:40.569516 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-eeb95799-3203-470c-ada4-51a127ac77f0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Returning 404 to user: Instance c0c59a20-ff75-456f-99b3-070207d951d7 could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:21:40.570449 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-eeb95799-3203-470c-ada4-51a127ac77f0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 404 len: 111 microversion: 2.20 time: 0.028042 Feb 21 04:21:40.571166 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 455/916] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:40 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 04:21:40.590471 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b044dadf-9dad-40f9-a8d9-ed1bb03be4cd tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '.version_select at 0x7feee5893f70>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:40.613845 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b044dadf-9dad-40f9-a8d9-ed1bb03be4cd tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139569516" status: 204 len: 0 microversion: 2.20 time: 0.027181 Feb 21 04:21:40.614550 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 462/917] 10.222.0.10 () {60 vars in 1261 bytes} [Mon Feb 21 04:21:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139569516 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 21 04:21:41.329555 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e2410aa9-b507-4a53-ae3d-487bb62fbd79 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Action: 'create', calling method: .version_select at 0x7feee14220d0>, body: {"keypair": {"name": "tempest-keypair-112505788"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:21:41.350038 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-e2410aa9-b507-4a53-ae3d-487bb62fbd79 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Getting quotas for project 53f9f8c7b6284a97b2c5ac5aee7f3c79. Resources: {'key_pairs'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:21:41.354190 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-e2410aa9-b507-4a53-ae3d-487bb62fbd79 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Getting quotas for user cd2b57fa426940dc8de7e72944ad4a80 and project 53f9f8c7b6284a97b2c5ac5aee7f3c79. Resources: {'key_pairs'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:21:41.511802 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-e2410aa9-b507-4a53-ae3d-487bb62fbd79 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Getting quotas for project 53f9f8c7b6284a97b2c5ac5aee7f3c79. Resources: {'key_pairs'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:21:41.515419 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-e2410aa9-b507-4a53-ae3d-487bb62fbd79 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Getting quotas for user cd2b57fa426940dc8de7e72944ad4a80 and project 53f9f8c7b6284a97b2c5ac5aee7f3c79. Resources: {'key_pairs'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:21:41.528975 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e2410aa9-b507-4a53-ae3d-487bb62fbd79 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.203218 Feb 21 04:21:41.529656 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 456/918] 10.222.0.10 () {62 vars in 1198 bytes} [Mon Feb 21 04:21:41 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 205 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Feb 21 04:21:42.780323 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1247499580", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81e10afa-1f4c-4986-8e6d-20263abcd54c"}], "security_groups": [{"name": "tempest-securitygroup--514520769"}], "key_name": "tempest-keypair-112505788", "user_data": "}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:21:42.882446 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.network.neutron [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] validate_networks() for [('81e10afa-1f4c-4986-8e6d-20263abcd54c', None, None, None, None, None)] {{(pid=116571) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:21:43.255436 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Flavor limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:21:43.255863 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Image limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:21:43.256366 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Flavor pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:21:43.256812 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Image pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:21:43.257228 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:21:43.266356 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:43.266803 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:43.267615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:43.268054 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:43.284615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Getting quotas for project 53f9f8c7b6284a97b2c5ac5aee7f3c79. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:21:43.288612 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Getting quotas for user cd2b57fa426940dc8de7e72944ad4a80 and project 53f9f8c7b6284a97b2c5ac5aee7f3c79. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:21:43.299340 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Going to run 1 instances... {{(pid=116571) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:21:43.302421 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:21:43.351634 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-699af0f9-c63d-4f04-b51a-67f74583806a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.576071 Feb 21 04:21:43.352202 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 463/919] 10.222.0.10 () {62 vars in 1187 bytes} [Mon Feb 21 04:21:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 21 04:21:43.361843 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a780bd0b-0657-4bde-a0e4-e08776adb55f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:43.362480 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a780bd0b-0657-4bde-a0e4-e08776adb55f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:43.417517 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a780bd0b-0657-4bde-a0e4-e08776adb55f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:43.425054 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a780bd0b-0657-4bde-a0e4-e08776adb55f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:43.427100 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a780bd0b-0657-4bde-a0e4-e08776adb55f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:43.428178 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a780bd0b-0657-4bde-a0e4-e08776adb55f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1281 microversion: 2.20 time: 0.070021 Feb 21 04:21:43.428957 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 457/920] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:43 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:44.446917 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-57ba7f45-db1d-49d3-ae09-5f792e07346a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:44.447669 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-57ba7f45-db1d-49d3-ae09-5f792e07346a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:44.454386 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-57ba7f45-db1d-49d3-ae09-5f792e07346a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:44.454834 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-57ba7f45-db1d-49d3-ae09-5f792e07346a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:44.455643 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-57ba7f45-db1d-49d3-ae09-5f792e07346a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:44.456081 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-57ba7f45-db1d-49d3-ae09-5f792e07346a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:44.522728 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-57ba7f45-db1d-49d3-ae09-5f792e07346a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:44.530624 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-57ba7f45-db1d-49d3-ae09-5f792e07346a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:44.532361 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-57ba7f45-db1d-49d3-ae09-5f792e07346a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:44.533623 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-57ba7f45-db1d-49d3-ae09-5f792e07346a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1339 microversion: 2.20 time: 0.090916 Feb 21 04:21:44.534482 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 464/921] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:44 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:45.551355 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8355c5f4-349d-480e-9b44-5545271ee461 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:45.552003 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8355c5f4-349d-480e-9b44-5545271ee461 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:45.558241 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8355c5f4-349d-480e-9b44-5545271ee461 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:45.558774 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8355c5f4-349d-480e-9b44-5545271ee461 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:45.559653 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8355c5f4-349d-480e-9b44-5545271ee461 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:45.560165 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8355c5f4-349d-480e-9b44-5545271ee461 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:45.578906 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-9f9d741b-f474-4974-8898-5f1e40fb1858 req-838604d0-644d-46ff-94ac-2f8d78450b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6ae5e7-0c3c-4a17-b846-0a427a7e609d", "tag": "1f9abb1e-20ab-4409-9680-aa349073bc5e"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:21:45.581339 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:21:45.581339 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:21:45.593903 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-9f9d741b-f474-4974-8898-5f1e40fb1858 req-838604d0-644d-46ff-94ac-2f8d78450b6a service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:45.594356 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-9f9d741b-f474-4974-8898-5f1e40fb1858 req-838604d0-644d-46ff-94ac-2f8d78450b6a service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:45.606594 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-9f9d741b-f474-4974-8898-5f1e40fb1858 req-838604d0-644d-46ff-94ac-2f8d78450b6a service nova] Creating event network-changed:1f9abb1e-20ab-4409-9680-aa349073bc5e for instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d on hv-cinder-77398 Feb 21 04:21:45.611807 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-9f9d741b-f474-4974-8898-5f1e40fb1858 req-838604d0-644d-46ff-94ac-2f8d78450b6a service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037475 Feb 21 04:21:45.612657 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 465/922] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:21:45.815672 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8355c5f4-349d-480e-9b44-5545271ee461 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:45.823850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8355c5f4-349d-480e-9b44-5545271ee461 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:45.825406 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8355c5f4-349d-480e-9b44-5545271ee461 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:45.826499 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8355c5f4-349d-480e-9b44-5545271ee461 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1406 microversion: 2.20 time: 0.279014 Feb 21 04:21:45.827059 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 458/923] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:45 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:46.845470 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b4bd239f-dc46-46cc-88ee-ecc3b8c1154c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:46.846167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b4bd239f-dc46-46cc-88ee-ecc3b8c1154c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:46.852708 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b4bd239f-dc46-46cc-88ee-ecc3b8c1154c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:46.853162 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b4bd239f-dc46-46cc-88ee-ecc3b8c1154c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:46.853945 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b4bd239f-dc46-46cc-88ee-ecc3b8c1154c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:46.854369 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b4bd239f-dc46-46cc-88ee-ecc3b8c1154c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:46.987850 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b4bd239f-dc46-46cc-88ee-ecc3b8c1154c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:46.995544 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b4bd239f-dc46-46cc-88ee-ecc3b8c1154c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:46.997059 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b4bd239f-dc46-46cc-88ee-ecc3b8c1154c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:46.998166 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b4bd239f-dc46-46cc-88ee-ecc3b8c1154c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1406 microversion: 2.20 time: 0.157320 Feb 21 04:21:46.998721 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 466/924] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:46 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:48.014973 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f0bf7449-3da8-4eee-8314-d4569faf2d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:48.015524 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f0bf7449-3da8-4eee-8314-d4569faf2d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:48.021766 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f0bf7449-3da8-4eee-8314-d4569faf2d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:48.022216 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f0bf7449-3da8-4eee-8314-d4569faf2d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:48.022994 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f0bf7449-3da8-4eee-8314-d4569faf2d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:48.023429 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f0bf7449-3da8-4eee-8314-d4569faf2d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:48.152078 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f0bf7449-3da8-4eee-8314-d4569faf2d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:48.160950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f0bf7449-3da8-4eee-8314-d4569faf2d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:48.162450 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f0bf7449-3da8-4eee-8314-d4569faf2d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:48.163547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f0bf7449-3da8-4eee-8314-d4569faf2d2c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1406 microversion: 2.20 time: 0.152338 Feb 21 04:21:48.164113 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 459/925] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:48 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:49.180917 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-20745777-b21a-4289-bb00-3dee45bd67b7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:49.181624 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-20745777-b21a-4289-bb00-3dee45bd67b7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:49.187829 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-20745777-b21a-4289-bb00-3dee45bd67b7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:49.188271 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-20745777-b21a-4289-bb00-3dee45bd67b7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:49.189062 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-20745777-b21a-4289-bb00-3dee45bd67b7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:49.189492 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-20745777-b21a-4289-bb00-3dee45bd67b7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:49.317694 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-20745777-b21a-4289-bb00-3dee45bd67b7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:49.325649 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-20745777-b21a-4289-bb00-3dee45bd67b7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:49.327299 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-20745777-b21a-4289-bb00-3dee45bd67b7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:49.328431 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-20745777-b21a-4289-bb00-3dee45bd67b7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1406 microversion: 2.20 time: 0.151172 Feb 21 04:21:49.329022 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 467/926] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:49 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:50.345493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8a67b435-c112-4d51-bb28-490a6e879319 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:50.346011 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8a67b435-c112-4d51-bb28-490a6e879319 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:50.352382 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8a67b435-c112-4d51-bb28-490a6e879319 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:50.352862 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8a67b435-c112-4d51-bb28-490a6e879319 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:50.353637 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8a67b435-c112-4d51-bb28-490a6e879319 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:50.354070 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8a67b435-c112-4d51-bb28-490a6e879319 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:50.485473 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8a67b435-c112-4d51-bb28-490a6e879319 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:50.493063 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8a67b435-c112-4d51-bb28-490a6e879319 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:50.494552 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8a67b435-c112-4d51-bb28-490a6e879319 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:50.495647 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8a67b435-c112-4d51-bb28-490a6e879319 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1406 microversion: 2.20 time: 0.153934 Feb 21 04:21:50.496212 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 460/927] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:50 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:51.513940 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e4cb8095-8f0e-404f-8768-94a968e36b66 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:51.514536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e4cb8095-8f0e-404f-8768-94a968e36b66 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:51.520772 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e4cb8095-8f0e-404f-8768-94a968e36b66 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:51.521222 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e4cb8095-8f0e-404f-8768-94a968e36b66 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:51.521986 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e4cb8095-8f0e-404f-8768-94a968e36b66 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:51.522418 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e4cb8095-8f0e-404f-8768-94a968e36b66 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:51.660042 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e4cb8095-8f0e-404f-8768-94a968e36b66 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:51.667621 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e4cb8095-8f0e-404f-8768-94a968e36b66 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:51.669124 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e4cb8095-8f0e-404f-8768-94a968e36b66 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:51.670206 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e4cb8095-8f0e-404f-8768-94a968e36b66 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1406 microversion: 2.20 time: 0.160002 Feb 21 04:21:51.670761 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 468/928] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:51 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:52.199275 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-4caa82cb-5d47-4eef-99c6-4d4ca403f961 req-a3494012-2556-4c0b-b98a-8d9cda18e507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6ae5e7-0c3c-4a17-b846-0a427a7e609d", "name": "network-vif-plugged", "status": "completed", "tag": "1f9abb1e-20ab-4409-9680-aa349073bc5e"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:21:52.200833 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:21:52.200833 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:21:52.208886 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-4caa82cb-5d47-4eef-99c6-4d4ca403f961 req-a3494012-2556-4c0b-b98a-8d9cda18e507 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:52.209399 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-4caa82cb-5d47-4eef-99c6-4d4ca403f961 req-a3494012-2556-4c0b-b98a-8d9cda18e507 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:52.221280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-4caa82cb-5d47-4eef-99c6-4d4ca403f961 req-a3494012-2556-4c0b-b98a-8d9cda18e507 service nova] Creating event network-vif-plugged:1f9abb1e-20ab-4409-9680-aa349073bc5e for instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d on hv-cinder-77398 Feb 21 04:21:52.226776 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-4caa82cb-5d47-4eef-99c6-4d4ca403f961 req-a3494012-2556-4c0b-b98a-8d9cda18e507 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031523 Feb 21 04:21:52.227541 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 461/929] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:21:52.688454 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9d2013a3-5ca7-49f5-8db9-4d7c14f6fef3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:52.689021 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9d2013a3-5ca7-49f5-8db9-4d7c14f6fef3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:52.695710 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9d2013a3-5ca7-49f5-8db9-4d7c14f6fef3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:52.696162 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9d2013a3-5ca7-49f5-8db9-4d7c14f6fef3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:52.696960 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9d2013a3-5ca7-49f5-8db9-4d7c14f6fef3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:52.697395 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9d2013a3-5ca7-49f5-8db9-4d7c14f6fef3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:52.826019 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9d2013a3-5ca7-49f5-8db9-4d7c14f6fef3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:52.834207 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9d2013a3-5ca7-49f5-8db9-4d7c14f6fef3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:52.835697 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9d2013a3-5ca7-49f5-8db9-4d7c14f6fef3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:52.836817 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9d2013a3-5ca7-49f5-8db9-4d7c14f6fef3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1406 microversion: 2.20 time: 0.152141 Feb 21 04:21:52.837370 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 469/930] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:52 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:53.855443 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f5296607-44ae-4207-894a-e9d0340a5aac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:53.856305 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f5296607-44ae-4207-894a-e9d0340a5aac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:53.863276 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f5296607-44ae-4207-894a-e9d0340a5aac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:53.863722 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f5296607-44ae-4207-894a-e9d0340a5aac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:53.864541 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f5296607-44ae-4207-894a-e9d0340a5aac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:53.865003 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f5296607-44ae-4207-894a-e9d0340a5aac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:53.996365 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f5296607-44ae-4207-894a-e9d0340a5aac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:54.004142 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f5296607-44ae-4207-894a-e9d0340a5aac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:54.005644 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f5296607-44ae-4207-894a-e9d0340a5aac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:21:54.006820 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f5296607-44ae-4207-894a-e9d0340a5aac tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1598 microversion: 2.20 time: 0.155595 Feb 21 04:21:54.007409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 462/931] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:21:53 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:21:54.024314 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-372807fe-c87e-447a-b8cb-abc733e5fa96 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:54.024839 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-372807fe-c87e-447a-b8cb-abc733e5fa96 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:54.031218 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-372807fe-c87e-447a-b8cb-abc733e5fa96 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:54.031671 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-372807fe-c87e-447a-b8cb-abc733e5fa96 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:54.032459 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-372807fe-c87e-447a-b8cb-abc733e5fa96 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:54.032930 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-372807fe-c87e-447a-b8cb-abc733e5fa96 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:54.116755 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-372807fe-c87e-447a-b8cb-abc733e5fa96 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096019 Feb 21 04:21:54.117353 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 470/932] 10.222.0.10 () {60 vars in 1315 bytes} [Mon Feb 21 04:21:54 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:21:54.672249 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ba94c65f-705b-4a8f-8bcb-fc97138da0ba tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1555835675"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:21:54.672819 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ba94c65f-705b-4a8f-8bcb-fc97138da0ba tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:54.679155 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ba94c65f-705b-4a8f-8bcb-fc97138da0ba tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:54.679607 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ba94c65f-705b-4a8f-8bcb-fc97138da0ba tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:54.680377 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ba94c65f-705b-4a8f-8bcb-fc97138da0ba tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:54.680859 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ba94c65f-705b-4a8f-8bcb-fc97138da0ba tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:55.162048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.network.security_group_api [None req-ba94c65f-705b-4a8f-8bcb-fc97138da0ba tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Removing security group ed61422c-2596-47a4-a867-ceb2b47dee59 from port 2f0ab78e-d156-44f8-a2e4-b409bf502408 Feb 21 04:21:55.550338 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e7ecc54a-f048-4dcb-9e0b-2aea7531ffbd tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:55.552206 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e7ecc54a-f048-4dcb-9e0b-2aea7531ffbd tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:55.560740 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e7ecc54a-f048-4dcb-9e0b-2aea7531ffbd tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:55.561297 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e7ecc54a-f048-4dcb-9e0b-2aea7531ffbd tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:55.562175 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e7ecc54a-f048-4dcb-9e0b-2aea7531ffbd tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:55.562709 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e7ecc54a-f048-4dcb-9e0b-2aea7531ffbd tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:55.590041 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e7ecc54a-f048-4dcb-9e0b-2aea7531ffbd tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/ips" status: 200 len: 112 microversion: 2.20 time: 0.046430 Feb 21 04:21:55.590625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 471/933] 10.222.0.10 () {60 vars in 1288 bytes} [Mon Feb 21 04:21:55 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/ips => generated 112 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:21:55.595750 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-00bd5f7b-8338-44b0-868f-9af7f37ab4ce req-2c76d314-3fc8-46b9-a309-43dc6c1d370a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6ae5e7-0c3c-4a17-b846-0a427a7e609d", "tag": "1f9abb1e-20ab-4409-9680-aa349073bc5e"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:21:55.596529 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:21:55.596529 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:21:55.604290 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-00bd5f7b-8338-44b0-868f-9af7f37ab4ce req-2c76d314-3fc8-46b9-a309-43dc6c1d370a service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:55.604779 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-00bd5f7b-8338-44b0-868f-9af7f37ab4ce req-2c76d314-3fc8-46b9-a309-43dc6c1d370a service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:55.618340 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-00bd5f7b-8338-44b0-868f-9af7f37ab4ce req-2c76d314-3fc8-46b9-a309-43dc6c1d370a service nova] Creating event network-changed:1f9abb1e-20ab-4409-9680-aa349073bc5e for instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d on hv-cinder-77398 Feb 21 04:21:55.624544 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-00bd5f7b-8338-44b0-868f-9af7f37ab4ce req-2c76d314-3fc8-46b9-a309-43dc6c1d370a service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032718 Feb 21 04:21:55.625472 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 472/934] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:21:55.706075 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ba94c65f-705b-4a8f-8bcb-fc97138da0ba tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "POST /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/action" status: 202 len: 0 microversion: 2.1 time: 1.192981 Feb 21 04:21:55.706690 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 463/935] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:21:54 2022] POST /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/action => generated 0 bytes in 1194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:21:57.192286 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c5e5a5ef-2f7a-4f69-838a-392d103454a3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:57.194549 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c5e5a5ef-2f7a-4f69-838a-392d103454a3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:57.204093 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c5e5a5ef-2f7a-4f69-838a-392d103454a3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:57.204674 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c5e5a5ef-2f7a-4f69-838a-392d103454a3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:57.205711 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c5e5a5ef-2f7a-4f69-838a-392d103454a3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:57.206245 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c5e5a5ef-2f7a-4f69-838a-392d103454a3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:57.259269 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-65d4ef7a-035a-4d20-ad62-0d5b6d6def06 req-e3d18831-e500-4a21-a386-2a7ac9957f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59362492-1a50-4bb3-a8a7-b29eb51489e4", "tag": "2f0ab78e-d156-44f8-a2e4-b409bf502408"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:21:57.261101 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:21:57.261101 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:21:57.268106 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-65d4ef7a-035a-4d20-ad62-0d5b6d6def06 req-e3d18831-e500-4a21-a386-2a7ac9957f94 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:57.268547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-65d4ef7a-035a-4d20-ad62-0d5b6d6def06 req-e3d18831-e500-4a21-a386-2a7ac9957f94 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:57.280417 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-65d4ef7a-035a-4d20-ad62-0d5b6d6def06 req-e3d18831-e500-4a21-a386-2a7ac9957f94 service nova] Creating event network-changed:2f0ab78e-d156-44f8-a2e4-b409bf502408 for instance 59362492-1a50-4bb3-a8a7-b29eb51489e4 on hv-cinder-77398 Feb 21 04:21:57.285487 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-65d4ef7a-035a-4d20-ad62-0d5b6d6def06 req-e3d18831-e500-4a21-a386-2a7ac9957f94 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098729 Feb 21 04:21:57.286085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 464/936] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:21:57.319336 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-c5e5a5ef-2f7a-4f69-838a-392d103454a3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lazy-loading 'services' on Instance uuid 59362492-1a50-4bb3-a8a7-b29eb51489e4 {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:21:57.395962 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c5e5a5ef-2f7a-4f69-838a-392d103454a3 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "DELETE /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/os-volume_attachments/c741b3b9-eaca-4db8-8fcb-21fc270d557f" status: 202 len: 0 microversion: 2.1 time: 0.212276 Feb 21 04:21:57.396480 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 473/937] 10.222.0.10 () {58 vars in 1415 bytes} [Mon Feb 21 04:21:57 2022] DELETE /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/os-volume_attachments/c741b3b9-eaca-4db8-8fcb-21fc270d557f => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:21:57.405613 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1fa175fc-7c41-4a2e-afeb-3ff1356943a5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:57.406851 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1fa175fc-7c41-4a2e-afeb-3ff1356943a5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:57.413395 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1fa175fc-7c41-4a2e-afeb-3ff1356943a5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:57.413843 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1fa175fc-7c41-4a2e-afeb-3ff1356943a5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:57.414626 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1fa175fc-7c41-4a2e-afeb-3ff1356943a5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:57.415241 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1fa175fc-7c41-4a2e-afeb-3ff1356943a5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:57.462237 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1fa175fc-7c41-4a2e-afeb-3ff1356943a5 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061188 Feb 21 04:21:57.463115 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 465/938] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:21:57 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:21:57.641916 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-79fe8d20-3c63-4197-98f5-19368a216df0 req-73b2e727-82b1-4bb9-a451-cae732966069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59362492-1a50-4bb3-a8a7-b29eb51489e4", "tag": "2f0ab78e-d156-44f8-a2e4-b409bf502408"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:21:57.643423 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:21:57.643423 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:21:57.650990 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-79fe8d20-3c63-4197-98f5-19368a216df0 req-73b2e727-82b1-4bb9-a451-cae732966069 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:57.653738 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-79fe8d20-3c63-4197-98f5-19368a216df0 req-73b2e727-82b1-4bb9-a451-cae732966069 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:57.664859 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-79fe8d20-3c63-4197-98f5-19368a216df0 req-73b2e727-82b1-4bb9-a451-cae732966069 service nova] Creating event network-changed:2f0ab78e-d156-44f8-a2e4-b409bf502408 for instance 59362492-1a50-4bb3-a8a7-b29eb51489e4 on hv-cinder-77398 Feb 21 04:21:57.669710 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-79fe8d20-3c63-4197-98f5-19368a216df0 req-73b2e727-82b1-4bb9-a451-cae732966069 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031806 Feb 21 04:21:57.670766 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 474/939] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:21:58.474398 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-24db5516-bc39-41a6-af1b-87158451175c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:58.475210 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-24db5516-bc39-41a6-af1b-87158451175c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:58.481410 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-24db5516-bc39-41a6-af1b-87158451175c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:58.481848 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-24db5516-bc39-41a6-af1b-87158451175c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:58.482611 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-24db5516-bc39-41a6-af1b-87158451175c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:58.483054 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-24db5516-bc39-41a6-af1b-87158451175c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:58.510965 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-24db5516-bc39-41a6-af1b-87158451175c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040993 Feb 21 04:21:58.511512 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 466/940] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:21:58 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 04:21:58.522224 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a3df4542-48dd-4899-8f5c-ca11842e3557 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:58.522798 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a3df4542-48dd-4899-8f5c-ca11842e3557 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:58.529407 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a3df4542-48dd-4899-8f5c-ca11842e3557 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:58.529843 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a3df4542-48dd-4899-8f5c-ca11842e3557 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:58.530618 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a3df4542-48dd-4899-8f5c-ca11842e3557 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:58.531041 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a3df4542-48dd-4899-8f5c-ca11842e3557 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:58.610801 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-a3df4542-48dd-4899-8f5c-ca11842e3557 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] HTTP exception thrown: Instance 59362492-1a50-4bb3-a8a7-b29eb51489e4 is not attached to volume c741b3b9-eaca-4db8-8fcb-21fc270d557f Feb 21 04:21:58.611405 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a3df4542-48dd-4899-8f5c-ca11842e3557 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Returning 404 to user: Instance 59362492-1a50-4bb3-a8a7-b29eb51489e4 is not attached to volume c741b3b9-eaca-4db8-8fcb-21fc270d557f {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:21:58.612272 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a3df4542-48dd-4899-8f5c-ca11842e3557 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "DELETE /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/os-volume_attachments/c741b3b9-eaca-4db8-8fcb-21fc270d557f" status: 404 len: 154 microversion: 2.1 time: 0.094651 Feb 21 04:21:58.612856 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 475/941] 10.222.0.10 () {58 vars in 1415 bytes} [Mon Feb 21 04:21:58 2022] DELETE /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4/os-volume_attachments/c741b3b9-eaca-4db8-8fcb-21fc270d557f => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:21:59.738897 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-580e6d59-2161-4000-8a92-ac48e9c7f31d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:59.739433 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-580e6d59-2161-4000-8a92-ac48e9c7f31d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:59.745615 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-580e6d59-2161-4000-8a92-ac48e9c7f31d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:59.746061 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-580e6d59-2161-4000-8a92-ac48e9c7f31d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:59.746826 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-580e6d59-2161-4000-8a92-ac48e9c7f31d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:59.747253 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-580e6d59-2161-4000-8a92-ac48e9c7f31d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:59.771316 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-580e6d59-2161-4000-8a92-ac48e9c7f31d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Going to try to terminate instance {{(pid=116570) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:21:59.841879 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-580e6d59-2161-4000-8a92-ac48e9c7f31d tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "DELETE /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 204 len: 0 microversion: 2.1 time: 0.106914 Feb 21 04:21:59.842464 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 467/942] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:21:59 2022] DELETE /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:21:59.850607 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d86a03d1-9e70-4a55-9d1c-315c3605c861 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:21:59.851228 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d86a03d1-9e70-4a55-9d1c-315c3605c861 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:21:59.857461 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d86a03d1-9e70-4a55-9d1c-315c3605c861 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:59.857909 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d86a03d1-9e70-4a55-9d1c-315c3605c861 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:21:59.858685 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d86a03d1-9e70-4a55-9d1c-315c3605c861 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:21:59.859122 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d86a03d1-9e70-4a55-9d1c-315c3605c861 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:00.000279 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d86a03d1-9e70-4a55-9d1c-315c3605c861 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:00.008165 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d86a03d1-9e70-4a55-9d1c-315c3605c861 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1555 microversion: 2.1 time: 0.161347 Feb 21 04:22:00.008740 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 476/943] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:21:59 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:01.025768 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-150bcc49-ee49-4759-b524-e590510fb832 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:01.026384 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-150bcc49-ee49-4759-b524-e590510fb832 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:01.032933 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-150bcc49-ee49-4759-b524-e590510fb832 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:01.033375 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-150bcc49-ee49-4759-b524-e590510fb832 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:01.034180 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-150bcc49-ee49-4759-b524-e590510fb832 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:01.034607 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-150bcc49-ee49-4759-b524-e590510fb832 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:01.238627 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-150bcc49-ee49-4759-b524-e590510fb832 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c146467155e643e3ac31a6f8976b1efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa514a3d1a314decab32eefda5e67939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:01.245893 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-150bcc49-ee49-4759-b524-e590510fb832 tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 200 len: 1555 microversion: 2.1 time: 0.224185 Feb 21 04:22:01.246410 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 468/944] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:01 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:22:01.562545 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-16f0b129-9a52-4dce-a5cc-df578319af8c req-50888652-38a3-48b0-8ae6-f85ad6cc5588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59362492-1a50-4bb3-a8a7-b29eb51489e4", "name": "network-vif-deleted", "tag": "2f0ab78e-d156-44f8-a2e4-b409bf502408"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:22:01.564089 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:22:01.564089 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:22:01.571999 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-16f0b129-9a52-4dce-a5cc-df578319af8c req-50888652-38a3-48b0-8ae6-f85ad6cc5588 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:01.572443 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-16f0b129-9a52-4dce-a5cc-df578319af8c req-50888652-38a3-48b0-8ae6-f85ad6cc5588 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:01.734111 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-16f0b129-9a52-4dce-a5cc-df578319af8c req-50888652-38a3-48b0-8ae6-f85ad6cc5588 service nova] Creating event network-vif-deleted:2f0ab78e-d156-44f8-a2e4-b409bf502408 for instance 59362492-1a50-4bb3-a8a7-b29eb51489e4 on hv-cinder-77398 Feb 21 04:22:01.739046 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-16f0b129-9a52-4dce-a5cc-df578319af8c req-50888652-38a3-48b0-8ae6-f85ad6cc5588 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180179 Feb 21 04:22:01.739739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 477/945] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:22:02.263278 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-001e176e-018e-449f-933a-798faa8ce84c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:02.263876 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-001e176e-018e-449f-933a-798faa8ce84c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] [instance: 59362492-1a50-4bb3-a8a7-b29eb51489e4] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:02.270685 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-001e176e-018e-449f-933a-798faa8ce84c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:02.271126 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-001e176e-018e-449f-933a-798faa8ce84c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:02.271888 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-001e176e-018e-449f-933a-798faa8ce84c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:02.272314 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-001e176e-018e-449f-933a-798faa8ce84c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:02.285854 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-001e176e-018e-449f-933a-798faa8ce84c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] HTTP exception thrown: Instance 59362492-1a50-4bb3-a8a7-b29eb51489e4 could not be found. Feb 21 04:22:02.286428 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-001e176e-018e-449f-933a-798faa8ce84c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Returning 404 to user: Instance 59362492-1a50-4bb3-a8a7-b29eb51489e4 could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:22:02.287227 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-001e176e-018e-449f-933a-798faa8ce84c tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4" status: 404 len: 111 microversion: 2.1 time: 0.027658 Feb 21 04:22:02.287743 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 469/946] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:02 2022] GET /compute/v2.1/servers/59362492-1a50-4bb3-a8a7-b29eb51489e4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:22:02.296183 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-aa36090d-0fb2-4168-8f63-e8f39a32f7ec tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] Calling method '.version_select at 0x7feee103e430>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:02.313739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-aa36090d-0fb2-4168-8f63-e8f39a32f7ec tempest-TestMinimumBasicScenario-98071882 tempest-TestMinimumBasicScenario-98071882-project] 10.222.0.10 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2043381222" status: 202 len: 0 microversion: 2.1 time: 0.021605 Feb 21 04:22:02.314279 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 478/947] 10.222.0.10 () {58 vars in 1271 bytes} [Mon Feb 21 04:22:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2043381222 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:22:20.657930 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-cf38aacc-6c48-425f-9758-6df77a90d748 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Action: 'create', calling method: .version_select at 0x7feee13adee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2040225681"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:22:20.671714 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-cf38aacc-6c48-425f-9758-6df77a90d748 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Getting quotas for project 35e5cd46d4684e9e9de6e634cfa13b5d. Resources: {'key_pairs'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:22:20.675984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-cf38aacc-6c48-425f-9758-6df77a90d748 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Getting quotas for user 157d93b90b374dd49ad9649be92b89a0 and project 35e5cd46d4684e9e9de6e634cfa13b5d. Resources: {'key_pairs'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:22:20.857543 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-cf38aacc-6c48-425f-9758-6df77a90d748 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Getting quotas for project 35e5cd46d4684e9e9de6e634cfa13b5d. Resources: {'key_pairs'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:22:20.861689 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-cf38aacc-6c48-425f-9758-6df77a90d748 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Getting quotas for user 157d93b90b374dd49ad9649be92b89a0 and project 35e5cd46d4684e9e9de6e634cfa13b5d. Resources: {'key_pairs'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:22:20.875548 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-cf38aacc-6c48-425f-9758-6df77a90d748 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.394093 Feb 21 04:22:20.876060 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 470/948] 10.222.0.10 () {60 vars in 1157 bytes} [Mon Feb 21 04:22:20 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:42.297562 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1904551943", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2040225681", "security_groups": [{"name": "tempest-secgroup-smoke-1307297902"}], "block_device_mapping_v2": [{"uuid": "6b5032e6-151d-468e-9696-649a64ed8264", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d8fa42c6-5e56-4a20-b94c-db6c502605e7"}]}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:22:42.403900 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.network.neutron [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] validate_networks() for [('d8fa42c6-5e56-4a20-b94c-db6c502605e7', None, None, None, None, None)] {{(pid=116571) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:22:42.760206 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Flavor limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:22:42.760644 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Image limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:22:42.761114 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Flavor pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:22:42.761517 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Image pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:22:42.761929 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:22:42.770459 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:42.770905 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:42.771757 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:42.772171 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:42.788826 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Getting quotas for project 35e5cd46d4684e9e9de6e634cfa13b5d. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:22:42.792603 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Getting quotas for user 157d93b90b374dd49ad9649be92b89a0 and project 35e5cd46d4684e9e9de6e634cfa13b5d. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:22:42.845475 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Going to run 1 instances... {{(pid=116571) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:22:42.847639 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b5032e6-151d-468e-9696-649a64ed8264',volume_size=None,volume_type=None)] {{(pid=116571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:22:42.964478 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-da7d61a7-54fb-4937-8b13-a635c8ddc41b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.670805 Feb 21 04:22:42.965236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 479/949] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:22:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:22:42.975919 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ab2b04fa-ea15-47cf-9993-a15e91afca5c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:42.976655 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ab2b04fa-ea15-47cf-9993-a15e91afca5c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:43.028852 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ab2b04fa-ea15-47cf-9993-a15e91afca5c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:43.035369 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ab2b04fa-ea15-47cf-9993-a15e91afca5c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1095 microversion: 2.1 time: 0.064239 Feb 21 04:22:43.035935 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 471/950] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:42 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:44.052681 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-17a9e597-d1ef-4f0c-a283-231ee1038995 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:44.053236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-17a9e597-d1ef-4f0c-a283-231ee1038995 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:44.060435 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-17a9e597-d1ef-4f0c-a283-231ee1038995 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:44.060905 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-17a9e597-d1ef-4f0c-a283-231ee1038995 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:44.061715 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-17a9e597-d1ef-4f0c-a283-231ee1038995 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:44.062131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-17a9e597-d1ef-4f0c-a283-231ee1038995 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:44.128070 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-17a9e597-d1ef-4f0c-a283-231ee1038995 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:44.136309 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-17a9e597-d1ef-4f0c-a283-231ee1038995 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1211 microversion: 2.1 time: 0.087303 Feb 21 04:22:44.136979 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 480/951] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:44 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:45.154402 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3022f3c2-f202-46e0-a60a-ceabc34b7b82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:45.159892 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-ea9a0013-97d8-43bf-aebe-5e9429228286 req-85c341fb-2e5d-4f1b-97c2-b31039f7e2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de498f5-d90a-4864-a2fd-8c7634d9b07a", "tag": "ca8d1428-556e-4ae9-b53c-d109c8daf6fe"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:22:45.161064 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3022f3c2-f202-46e0-a60a-ceabc34b7b82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:45.162360 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:22:45.162360 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:22:45.169707 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3022f3c2-f202-46e0-a60a-ceabc34b7b82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:45.171449 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3022f3c2-f202-46e0-a60a-ceabc34b7b82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:45.172475 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3022f3c2-f202-46e0-a60a-ceabc34b7b82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:45.173308 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3022f3c2-f202-46e0-a60a-ceabc34b7b82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:45.176178 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-ea9a0013-97d8-43bf-aebe-5e9429228286 req-85c341fb-2e5d-4f1b-97c2-b31039f7e2dc service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:45.176657 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-ea9a0013-97d8-43bf-aebe-5e9429228286 req-85c341fb-2e5d-4f1b-97c2-b31039f7e2dc service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:45.190778 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-ea9a0013-97d8-43bf-aebe-5e9429228286 req-85c341fb-2e5d-4f1b-97c2-b31039f7e2dc service nova] Creating event network-changed:ca8d1428-556e-4ae9-b53c-d109c8daf6fe for instance 5de498f5-d90a-4864-a2fd-8c7634d9b07a on hv-cinder-77398 Feb 21 04:22:45.196819 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-ea9a0013-97d8-43bf-aebe-5e9429228286 req-85c341fb-2e5d-4f1b-97c2-b31039f7e2dc service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040589 Feb 21 04:22:45.197828 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 481/952] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:22:45.639012 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3022f3c2-f202-46e0-a60a-ceabc34b7b82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:45.646328 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3022f3c2-f202-46e0-a60a-ceabc34b7b82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1267 microversion: 2.1 time: 0.496315 Feb 21 04:22:45.647416 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 472/953] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:45 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1267 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:46.666998 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-abb3b79d-633e-43e5-8a87-de4f405da2dc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:46.667880 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-abb3b79d-633e-43e5-8a87-de4f405da2dc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:46.674660 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-abb3b79d-633e-43e5-8a87-de4f405da2dc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:46.675110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-abb3b79d-633e-43e5-8a87-de4f405da2dc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:46.675922 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-abb3b79d-633e-43e5-8a87-de4f405da2dc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:46.676353 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-abb3b79d-633e-43e5-8a87-de4f405da2dc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:46.813775 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-abb3b79d-633e-43e5-8a87-de4f405da2dc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:46.820949 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-abb3b79d-633e-43e5-8a87-de4f405da2dc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1267 microversion: 2.1 time: 0.160447 Feb 21 04:22:46.821513 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 482/954] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:46 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:47.838218 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e4f58dcc-3e0e-44bb-8410-174a348b4dfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:47.838864 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e4f58dcc-3e0e-44bb-8410-174a348b4dfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:47.845110 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e4f58dcc-3e0e-44bb-8410-174a348b4dfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:47.845549 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e4f58dcc-3e0e-44bb-8410-174a348b4dfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:47.846327 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e4f58dcc-3e0e-44bb-8410-174a348b4dfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:47.846766 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e4f58dcc-3e0e-44bb-8410-174a348b4dfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:47.976104 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e4f58dcc-3e0e-44bb-8410-174a348b4dfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:47.983215 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e4f58dcc-3e0e-44bb-8410-174a348b4dfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1267 microversion: 2.1 time: 0.149252 Feb 21 04:22:47.983778 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 473/955] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:47 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:49.000502 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b9685c50-9cc4-4f74-a629-cb546ed1eb0e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:49.001119 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b9685c50-9cc4-4f74-a629-cb546ed1eb0e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:49.008078 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b9685c50-9cc4-4f74-a629-cb546ed1eb0e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:49.008522 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b9685c50-9cc4-4f74-a629-cb546ed1eb0e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:49.009317 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b9685c50-9cc4-4f74-a629-cb546ed1eb0e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:49.009746 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b9685c50-9cc4-4f74-a629-cb546ed1eb0e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:49.144081 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b9685c50-9cc4-4f74-a629-cb546ed1eb0e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:49.151826 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b9685c50-9cc4-4f74-a629-cb546ed1eb0e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1267 microversion: 2.1 time: 0.155066 Feb 21 04:22:49.152383 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 483/956] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:48 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:50.169069 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1694ab48-8c18-4cbc-8e46-768e9c114c37 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:50.169679 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1694ab48-8c18-4cbc-8e46-768e9c114c37 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:50.175857 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1694ab48-8c18-4cbc-8e46-768e9c114c37 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:50.176309 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1694ab48-8c18-4cbc-8e46-768e9c114c37 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:50.177102 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1694ab48-8c18-4cbc-8e46-768e9c114c37 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:50.177536 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1694ab48-8c18-4cbc-8e46-768e9c114c37 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:50.313735 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1694ab48-8c18-4cbc-8e46-768e9c114c37 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:50.321653 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1694ab48-8c18-4cbc-8e46-768e9c114c37 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1267 microversion: 2.1 time: 0.156194 Feb 21 04:22:50.322226 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 474/957] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:50 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:51.337798 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0ce61ba3-5345-453b-b12c-a1696b6a852b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:51.338405 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0ce61ba3-5345-453b-b12c-a1696b6a852b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:51.344542 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0ce61ba3-5345-453b-b12c-a1696b6a852b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:51.345014 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0ce61ba3-5345-453b-b12c-a1696b6a852b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:51.345784 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0ce61ba3-5345-453b-b12c-a1696b6a852b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:51.346213 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0ce61ba3-5345-453b-b12c-a1696b6a852b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:51.478273 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0ce61ba3-5345-453b-b12c-a1696b6a852b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:51.485699 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0ce61ba3-5345-453b-b12c-a1696b6a852b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1267 microversion: 2.1 time: 0.152190 Feb 21 04:22:51.486257 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 484/958] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:51 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:52.502712 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fa069a0b-cf49-4430-8ef3-685b8a945fe6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:52.503323 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fa069a0b-cf49-4430-8ef3-685b8a945fe6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:52.509782 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fa069a0b-cf49-4430-8ef3-685b8a945fe6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:52.510223 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fa069a0b-cf49-4430-8ef3-685b8a945fe6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:52.510985 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fa069a0b-cf49-4430-8ef3-685b8a945fe6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:52.511410 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fa069a0b-cf49-4430-8ef3-685b8a945fe6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:52.642125 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fa069a0b-cf49-4430-8ef3-685b8a945fe6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:52.650093 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fa069a0b-cf49-4430-8ef3-685b8a945fe6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1267 microversion: 2.1 time: 0.151114 Feb 21 04:22:52.650676 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 475/959] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:52 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:53.667718 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-26076aa2-602d-4de2-9edb-1392ee13dfe4 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:53.668358 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-26076aa2-602d-4de2-9edb-1392ee13dfe4 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:53.674634 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26076aa2-602d-4de2-9edb-1392ee13dfe4 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:53.675081 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26076aa2-602d-4de2-9edb-1392ee13dfe4 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:53.675853 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26076aa2-602d-4de2-9edb-1392ee13dfe4 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:53.676289 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26076aa2-602d-4de2-9edb-1392ee13dfe4 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:53.809376 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-26076aa2-602d-4de2-9edb-1392ee13dfe4 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:53.816480 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-26076aa2-602d-4de2-9edb-1392ee13dfe4 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1267 microversion: 2.1 time: 0.152450 Feb 21 04:22:53.817063 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 485/960] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:53 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:54.833079 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7d00a104-e8d6-409b-906b-e706b16ae908 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:54.833621 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7d00a104-e8d6-409b-906b-e706b16ae908 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:54.839819 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7d00a104-e8d6-409b-906b-e706b16ae908 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:54.840265 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7d00a104-e8d6-409b-906b-e706b16ae908 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:54.841066 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7d00a104-e8d6-409b-906b-e706b16ae908 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:54.841493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7d00a104-e8d6-409b-906b-e706b16ae908 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:54.988908 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7d00a104-e8d6-409b-906b-e706b16ae908 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:54.996751 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7d00a104-e8d6-409b-906b-e706b16ae908 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1267 microversion: 2.1 time: 0.167293 Feb 21 04:22:54.997543 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 476/961] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:54 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:56.014819 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a6075c2a-ec70-4fad-b4e7-cf2ffd2f702b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:56.015429 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a6075c2a-ec70-4fad-b4e7-cf2ffd2f702b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:56.021704 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6075c2a-ec70-4fad-b4e7-cf2ffd2f702b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:56.022095 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6075c2a-ec70-4fad-b4e7-cf2ffd2f702b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:56.022871 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6075c2a-ec70-4fad-b4e7-cf2ffd2f702b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:56.023811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6075c2a-ec70-4fad-b4e7-cf2ffd2f702b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:56.158009 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a6075c2a-ec70-4fad-b4e7-cf2ffd2f702b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:56.165854 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a6075c2a-ec70-4fad-b4e7-cf2ffd2f702b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1267 microversion: 2.1 time: 0.154650 Feb 21 04:22:56.166372 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 486/962] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:56 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:56.500351 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-5d9954f9-159d-4569-908a-2810ddb705d6 req-d7d80858-bc2b-4310-b393-aeb187672b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de498f5-d90a-4864-a2fd-8c7634d9b07a", "name": "network-vif-plugged", "status": "completed", "tag": "ca8d1428-556e-4ae9-b53c-d109c8daf6fe"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:22:56.501941 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:22:56.501941 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:22:56.510152 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-5d9954f9-159d-4569-908a-2810ddb705d6 req-d7d80858-bc2b-4310-b393-aeb187672b7f service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:56.510602 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-5d9954f9-159d-4569-908a-2810ddb705d6 req-d7d80858-bc2b-4310-b393-aeb187672b7f service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:56.521498 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-5d9954f9-159d-4569-908a-2810ddb705d6 req-d7d80858-bc2b-4310-b393-aeb187672b7f service nova] Creating event network-vif-plugged:ca8d1428-556e-4ae9-b53c-d109c8daf6fe for instance 5de498f5-d90a-4864-a2fd-8c7634d9b07a on hv-cinder-77398 Feb 21 04:22:56.527140 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-5d9954f9-159d-4569-908a-2810ddb705d6 req-d7d80858-bc2b-4310-b393-aeb187672b7f service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030381 Feb 21 04:22:56.527724 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 477/963] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:22:57.189119 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d8acfb56-9e64-40b4-bba8-6cec0f9d2ba2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:57.189733 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d8acfb56-9e64-40b4-bba8-6cec0f9d2ba2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:57.196572 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d8acfb56-9e64-40b4-bba8-6cec0f9d2ba2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:57.197052 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d8acfb56-9e64-40b4-bba8-6cec0f9d2ba2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:57.197829 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d8acfb56-9e64-40b4-bba8-6cec0f9d2ba2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:57.198268 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d8acfb56-9e64-40b4-bba8-6cec0f9d2ba2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:57.333527 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d8acfb56-9e64-40b4-bba8-6cec0f9d2ba2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:57.340612 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d8acfb56-9e64-40b4-bba8-6cec0f9d2ba2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1267 microversion: 2.1 time: 0.155124 Feb 21 04:22:57.341176 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 487/964] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:57 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:22:58.358028 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9e104d8f-e7e8-4a9a-aefb-bf7bfac7d931 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:58.358720 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9e104d8f-e7e8-4a9a-aefb-bf7bfac7d931 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:58.364725 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9e104d8f-e7e8-4a9a-aefb-bf7bfac7d931 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:58.365167 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9e104d8f-e7e8-4a9a-aefb-bf7bfac7d931 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:58.365924 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9e104d8f-e7e8-4a9a-aefb-bf7bfac7d931 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:58.366355 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9e104d8f-e7e8-4a9a-aefb-bf7bfac7d931 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:58.497215 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9e104d8f-e7e8-4a9a-aefb-bf7bfac7d931 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:58.504366 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9e104d8f-e7e8-4a9a-aefb-bf7bfac7d931 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1455 microversion: 2.1 time: 0.150818 Feb 21 04:22:58.504960 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 478/965] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:58 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:22:58.520652 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c6a5cc4a-8417-434e-8830-2673390b352f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:22:58.521296 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c6a5cc4a-8417-434e-8830-2673390b352f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:22:58.527594 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c6a5cc4a-8417-434e-8830-2673390b352f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:58.528316 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c6a5cc4a-8417-434e-8830-2673390b352f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:58.529093 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c6a5cc4a-8417-434e-8830-2673390b352f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:22:58.529535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c6a5cc4a-8417-434e-8830-2673390b352f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:22:58.663933 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c6a5cc4a-8417-434e-8830-2673390b352f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:22:58.671458 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c6a5cc4a-8417-434e-8830-2673390b352f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1455 microversion: 2.1 time: 0.154406 Feb 21 04:22:58.672004 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 488/966] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:22:58 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:23:00.375409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-e15bee32-6847-4357-bae4-481283d73684 req-2f891d05-578b-4a9a-a4b4-26e40ebd8065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de498f5-d90a-4864-a2fd-8c7634d9b07a", "tag": "ca8d1428-556e-4ae9-b53c-d109c8daf6fe"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:23:00.376947 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:23:00.376947 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:23:00.384126 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-e15bee32-6847-4357-bae4-481283d73684 req-2f891d05-578b-4a9a-a4b4-26e40ebd8065 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:00.384564 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-e15bee32-6847-4357-bae4-481283d73684 req-2f891d05-578b-4a9a-a4b4-26e40ebd8065 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:00.394916 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-e15bee32-6847-4357-bae4-481283d73684 req-2f891d05-578b-4a9a-a4b4-26e40ebd8065 service nova] Creating event network-changed:ca8d1428-556e-4ae9-b53c-d109c8daf6fe for instance 5de498f5-d90a-4864-a2fd-8c7634d9b07a on hv-cinder-77398 Feb 21 04:23:00.400166 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-e15bee32-6847-4357-bae4-481283d73684 req-2f891d05-578b-4a9a-a4b4-26e40ebd8065 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028261 Feb 21 04:23:00.401096 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 479/967] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:23:13.045989 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d314480c-0969-4cdc-ae26-4b0fd1f0cc44 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:23:13.046554 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d314480c-0969-4cdc-ae26-4b0fd1f0cc44 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:13.052686 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d314480c-0969-4cdc-ae26-4b0fd1f0cc44 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:13.053134 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d314480c-0969-4cdc-ae26-4b0fd1f0cc44 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:13.053906 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d314480c-0969-4cdc-ae26-4b0fd1f0cc44 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:13.054338 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d314480c-0969-4cdc-ae26-4b0fd1f0cc44 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:13.076231 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-d314480c-0969-4cdc-ae26-4b0fd1f0cc44 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lazy-loading 'flavor' on Instance uuid fd6ae5e7-0c3c-4a17-b846-0a427a7e609d {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:23:13.324695 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d314480c-0969-4cdc-ae26-4b0fd1f0cc44 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "POST /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/action" status: 202 len: 0 microversion: 2.20 time: 0.282183 Feb 21 04:23:13.325312 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 489/968] 10.222.0.10 () {62 vars in 1318 bytes} [Mon Feb 21 04:23:13 2022] POST /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:23:13.334799 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3e55ceac-11b5-492a-8fe0-bcc8695392e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:13.335458 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3e55ceac-11b5-492a-8fe0-bcc8695392e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:13.341640 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3e55ceac-11b5-492a-8fe0-bcc8695392e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:13.342031 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3e55ceac-11b5-492a-8fe0-bcc8695392e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:13.342841 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3e55ceac-11b5-492a-8fe0-bcc8695392e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:13.343337 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3e55ceac-11b5-492a-8fe0-bcc8695392e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:13.483417 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3e55ceac-11b5-492a-8fe0-bcc8695392e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:13.491325 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3e55ceac-11b5-492a-8fe0-bcc8695392e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:13.493500 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3e55ceac-11b5-492a-8fe0-bcc8695392e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:13.494657 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3e55ceac-11b5-492a-8fe0-bcc8695392e1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1722 microversion: 2.20 time: 0.164569 Feb 21 04:23:13.495261 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 480/969] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:13 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:14.514359 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e907ca3a-0c95-4fce-8296-f394cda628b9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:14.515049 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e907ca3a-0c95-4fce-8296-f394cda628b9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:14.521221 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e907ca3a-0c95-4fce-8296-f394cda628b9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:14.521668 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e907ca3a-0c95-4fce-8296-f394cda628b9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:14.522438 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e907ca3a-0c95-4fce-8296-f394cda628b9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:14.523390 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e907ca3a-0c95-4fce-8296-f394cda628b9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:14.654248 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e907ca3a-0c95-4fce-8296-f394cda628b9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:14.661935 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e907ca3a-0c95-4fce-8296-f394cda628b9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:14.663427 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e907ca3a-0c95-4fce-8296-f394cda628b9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:14.664580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e907ca3a-0c95-4fce-8296-f394cda628b9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1722 microversion: 2.20 time: 0.154712 Feb 21 04:23:14.665145 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 490/970] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:14 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:15.682591 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a3bfc0a9-22ee-4d2d-9a4b-c5411036a7bc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:15.683194 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a3bfc0a9-22ee-4d2d-9a4b-c5411036a7bc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:15.689307 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a3bfc0a9-22ee-4d2d-9a4b-c5411036a7bc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:15.689754 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a3bfc0a9-22ee-4d2d-9a4b-c5411036a7bc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:15.690519 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a3bfc0a9-22ee-4d2d-9a4b-c5411036a7bc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:15.690948 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a3bfc0a9-22ee-4d2d-9a4b-c5411036a7bc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:15.823436 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a3bfc0a9-22ee-4d2d-9a4b-c5411036a7bc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:15.830933 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a3bfc0a9-22ee-4d2d-9a4b-c5411036a7bc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:15.832412 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a3bfc0a9-22ee-4d2d-9a4b-c5411036a7bc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:15.833580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a3bfc0a9-22ee-4d2d-9a4b-c5411036a7bc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1722 microversion: 2.20 time: 0.154810 Feb 21 04:23:15.834130 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 481/971] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:15 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:16.852945 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-dc6d8828-7e6b-4533-8fdd-84d49c548184 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:16.853555 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-dc6d8828-7e6b-4533-8fdd-84d49c548184 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:16.859464 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc6d8828-7e6b-4533-8fdd-84d49c548184 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:16.859913 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc6d8828-7e6b-4533-8fdd-84d49c548184 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:16.860717 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc6d8828-7e6b-4533-8fdd-84d49c548184 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:16.861146 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dc6d8828-7e6b-4533-8fdd-84d49c548184 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:16.990168 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dc6d8828-7e6b-4533-8fdd-84d49c548184 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:16.997742 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dc6d8828-7e6b-4533-8fdd-84d49c548184 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:16.999260 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dc6d8828-7e6b-4533-8fdd-84d49c548184 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:17.000396 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-dc6d8828-7e6b-4533-8fdd-84d49c548184 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1722 microversion: 2.20 time: 0.151956 Feb 21 04:23:17.000986 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 491/972] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:16 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:18.018196 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1c25a966-c6e6-4d3d-8521-3cda5bc0ad0d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:18.018811 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1c25a966-c6e6-4d3d-8521-3cda5bc0ad0d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:18.025264 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1c25a966-c6e6-4d3d-8521-3cda5bc0ad0d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:18.025712 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1c25a966-c6e6-4d3d-8521-3cda5bc0ad0d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:18.026494 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1c25a966-c6e6-4d3d-8521-3cda5bc0ad0d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:18.026928 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1c25a966-c6e6-4d3d-8521-3cda5bc0ad0d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:18.223047 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1c25a966-c6e6-4d3d-8521-3cda5bc0ad0d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:18.230700 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1c25a966-c6e6-4d3d-8521-3cda5bc0ad0d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:18.232166 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1c25a966-c6e6-4d3d-8521-3cda5bc0ad0d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:18.233350 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1c25a966-c6e6-4d3d-8521-3cda5bc0ad0d tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1722 microversion: 2.20 time: 0.218867 Feb 21 04:23:18.233904 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 482/973] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:18 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:19.251008 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3fc67462-431f-46d8-a5a8-64093fcb1166 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:19.251624 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3fc67462-431f-46d8-a5a8-64093fcb1166 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:19.257742 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3fc67462-431f-46d8-a5a8-64093fcb1166 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:19.258186 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3fc67462-431f-46d8-a5a8-64093fcb1166 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:19.258948 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3fc67462-431f-46d8-a5a8-64093fcb1166 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:19.259374 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3fc67462-431f-46d8-a5a8-64093fcb1166 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:19.392374 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-3fc67462-431f-46d8-a5a8-64093fcb1166 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:19.400599 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-3fc67462-431f-46d8-a5a8-64093fcb1166 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:19.402092 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-3fc67462-431f-46d8-a5a8-64093fcb1166 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:19.403547 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3fc67462-431f-46d8-a5a8-64093fcb1166 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1722 microversion: 2.20 time: 0.156196 Feb 21 04:23:19.404097 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 492/974] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:19 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:23:20.421356 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-91059277-92c5-4c0b-b907-640a988a70e9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:20.421987 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-91059277-92c5-4c0b-b907-640a988a70e9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:20.428239 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-91059277-92c5-4c0b-b907-640a988a70e9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:20.428712 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-91059277-92c5-4c0b-b907-640a988a70e9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:20.429486 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-91059277-92c5-4c0b-b907-640a988a70e9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:20.429962 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-91059277-92c5-4c0b-b907-640a988a70e9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:20.559084 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-91059277-92c5-4c0b-b907-640a988a70e9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:20.566692 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-91059277-92c5-4c0b-b907-640a988a70e9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:20.568175 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-91059277-92c5-4c0b-b907-640a988a70e9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:20.569433 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-91059277-92c5-4c0b-b907-640a988a70e9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1722 microversion: 2.20 time: 0.151816 Feb 21 04:23:20.569989 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 483/975] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:20 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:21.588953 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5a0ad125-26cf-484a-96e3-1a5a5a3edc88 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:21.589484 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5a0ad125-26cf-484a-96e3-1a5a5a3edc88 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:21.595661 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5a0ad125-26cf-484a-96e3-1a5a5a3edc88 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:21.596113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5a0ad125-26cf-484a-96e3-1a5a5a3edc88 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:21.596906 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5a0ad125-26cf-484a-96e3-1a5a5a3edc88 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:21.597336 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5a0ad125-26cf-484a-96e3-1a5a5a3edc88 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:21.728608 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5a0ad125-26cf-484a-96e3-1a5a5a3edc88 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:21.736153 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5a0ad125-26cf-484a-96e3-1a5a5a3edc88 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:21.737655 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5a0ad125-26cf-484a-96e3-1a5a5a3edc88 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:21.738802 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5a0ad125-26cf-484a-96e3-1a5a5a3edc88 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1722 microversion: 2.20 time: 0.154190 Feb 21 04:23:21.739349 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 493/976] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:21 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:22.756648 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e5b56e93-660e-45c0-8779-bd148cdb09a3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:22.757281 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e5b56e93-660e-45c0-8779-bd148cdb09a3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:22.763642 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e5b56e93-660e-45c0-8779-bd148cdb09a3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:22.764087 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e5b56e93-660e-45c0-8779-bd148cdb09a3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:22.764895 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e5b56e93-660e-45c0-8779-bd148cdb09a3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:22.765328 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e5b56e93-660e-45c0-8779-bd148cdb09a3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:22.893131 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e5b56e93-660e-45c0-8779-bd148cdb09a3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:22.901465 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e5b56e93-660e-45c0-8779-bd148cdb09a3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:22.903206 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e5b56e93-660e-45c0-8779-bd148cdb09a3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:22.904340 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e5b56e93-660e-45c0-8779-bd148cdb09a3 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1722 microversion: 2.20 time: 0.151559 Feb 21 04:23:22.904967 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 484/977] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:22 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:23.922712 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-99e69761-7bdd-4a53-808e-f99bba747d68 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:23.923321 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-99e69761-7bdd-4a53-808e-f99bba747d68 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:23.930057 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-99e69761-7bdd-4a53-808e-f99bba747d68 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:23.930504 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-99e69761-7bdd-4a53-808e-f99bba747d68 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:23.931271 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-99e69761-7bdd-4a53-808e-f99bba747d68 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:23.931708 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-99e69761-7bdd-4a53-808e-f99bba747d68 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:24.071512 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-99e69761-7bdd-4a53-808e-f99bba747d68 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:24.079065 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-99e69761-7bdd-4a53-808e-f99bba747d68 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:24.080586 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-99e69761-7bdd-4a53-808e-f99bba747d68 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:24.081796 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-99e69761-7bdd-4a53-808e-f99bba747d68 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1722 microversion: 2.20 time: 0.162859 Feb 21 04:23:24.082350 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 494/978] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:23 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:25.099816 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1372b80e-bb49-464d-88ee-3c17018de041 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:25.100361 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1372b80e-bb49-464d-88ee-3c17018de041 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:25.106867 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1372b80e-bb49-464d-88ee-3c17018de041 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:25.107316 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1372b80e-bb49-464d-88ee-3c17018de041 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:25.108095 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1372b80e-bb49-464d-88ee-3c17018de041 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:25.108571 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1372b80e-bb49-464d-88ee-3c17018de041 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:25.243984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1372b80e-bb49-464d-88ee-3c17018de041 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:25.251181 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1372b80e-bb49-464d-88ee-3c17018de041 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:25.252715 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1372b80e-bb49-464d-88ee-3c17018de041 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:25.253858 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1372b80e-bb49-464d-88ee-3c17018de041 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1743 microversion: 2.20 time: 0.157819 Feb 21 04:23:25.254414 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 485/979] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:25 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:26.272677 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4f336aa9-c220-4be3-8710-3f247483504a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:26.273869 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4f336aa9-c220-4be3-8710-3f247483504a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:26.280336 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4f336aa9-c220-4be3-8710-3f247483504a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:26.280811 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4f336aa9-c220-4be3-8710-3f247483504a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:26.281606 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4f336aa9-c220-4be3-8710-3f247483504a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:26.282034 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4f336aa9-c220-4be3-8710-3f247483504a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:26.422163 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4f336aa9-c220-4be3-8710-3f247483504a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:26.430363 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4f336aa9-c220-4be3-8710-3f247483504a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:26.431854 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4f336aa9-c220-4be3-8710-3f247483504a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:26.433068 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4f336aa9-c220-4be3-8710-3f247483504a tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1743 microversion: 2.20 time: 0.164032 Feb 21 04:23:26.433613 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 495/980] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:26 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:27.452141 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-16a97dff-a578-4b37-987a-5e1cf9fc5b38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:27.452936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-16a97dff-a578-4b37-987a-5e1cf9fc5b38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:27.459853 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16a97dff-a578-4b37-987a-5e1cf9fc5b38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:27.460294 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16a97dff-a578-4b37-987a-5e1cf9fc5b38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:27.461095 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16a97dff-a578-4b37-987a-5e1cf9fc5b38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:27.461521 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16a97dff-a578-4b37-987a-5e1cf9fc5b38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:27.598059 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-16a97dff-a578-4b37-987a-5e1cf9fc5b38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:27.605906 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-16a97dff-a578-4b37-987a-5e1cf9fc5b38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:27.607398 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-16a97dff-a578-4b37-987a-5e1cf9fc5b38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:27.608552 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-16a97dff-a578-4b37-987a-5e1cf9fc5b38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1743 microversion: 2.20 time: 0.160697 Feb 21 04:23:27.609146 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 486/981] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:27 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:28.626447 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d39ee27d-4cb5-4494-80a0-6d15193e205b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:28.627046 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d39ee27d-4cb5-4494-80a0-6d15193e205b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:28.633862 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d39ee27d-4cb5-4494-80a0-6d15193e205b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:28.634305 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d39ee27d-4cb5-4494-80a0-6d15193e205b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:28.635078 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d39ee27d-4cb5-4494-80a0-6d15193e205b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:28.635511 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d39ee27d-4cb5-4494-80a0-6d15193e205b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:28.661613 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-960b6966-4240-4e8a-b02a-76ed1dd937a7 req-5d56beea-ff5e-482d-accb-2582c1eccb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6ae5e7-0c3c-4a17-b846-0a427a7e609d", "name": "network-vif-plugged", "status": "completed", "tag": "1f9abb1e-20ab-4409-9680-aa349073bc5e"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:23:28.663196 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:23:28.663196 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:23:28.671092 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-960b6966-4240-4e8a-b02a-76ed1dd937a7 req-5d56beea-ff5e-482d-accb-2582c1eccb07 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:28.671922 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-960b6966-4240-4e8a-b02a-76ed1dd937a7 req-5d56beea-ff5e-482d-accb-2582c1eccb07 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:28.684073 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-960b6966-4240-4e8a-b02a-76ed1dd937a7 req-5d56beea-ff5e-482d-accb-2582c1eccb07 service nova] Creating event network-vif-plugged:1f9abb1e-20ab-4409-9680-aa349073bc5e for instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d on hv-cinder-77398 Feb 21 04:23:28.689078 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-960b6966-4240-4e8a-b02a-76ed1dd937a7 req-5d56beea-ff5e-482d-accb-2582c1eccb07 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031273 Feb 21 04:23:28.689847 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 487/982] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:23:28.770521 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d39ee27d-4cb5-4494-80a0-6d15193e205b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:28.779184 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d39ee27d-4cb5-4494-80a0-6d15193e205b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:28.780700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d39ee27d-4cb5-4494-80a0-6d15193e205b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:28.781856 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d39ee27d-4cb5-4494-80a0-6d15193e205b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1743 microversion: 2.20 time: 0.159083 Feb 21 04:23:28.782412 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 496/983] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:28 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:29.799925 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f9e70bba-8a64-450b-9990-cfdf3c428194 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:29.800651 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f9e70bba-8a64-450b-9990-cfdf3c428194 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:29.806697 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f9e70bba-8a64-450b-9990-cfdf3c428194 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:29.807149 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f9e70bba-8a64-450b-9990-cfdf3c428194 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:29.807922 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f9e70bba-8a64-450b-9990-cfdf3c428194 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:29.808357 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f9e70bba-8a64-450b-9990-cfdf3c428194 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:29.941546 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f9e70bba-8a64-450b-9990-cfdf3c428194 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:29.949191 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f9e70bba-8a64-450b-9990-cfdf3c428194 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:29.950695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f9e70bba-8a64-450b-9990-cfdf3c428194 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:29.951843 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f9e70bba-8a64-450b-9990-cfdf3c428194 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1743 microversion: 2.20 time: 0.156448 Feb 21 04:23:29.952412 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 488/984] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:29 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:30.970308 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b4814284-3323-4537-bfe4-a367d452dd38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:30.970855 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b4814284-3323-4537-bfe4-a367d452dd38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:30.977808 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b4814284-3323-4537-bfe4-a367d452dd38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:30.978264 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b4814284-3323-4537-bfe4-a367d452dd38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:30.979047 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b4814284-3323-4537-bfe4-a367d452dd38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:30.979481 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b4814284-3323-4537-bfe4-a367d452dd38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:31.125856 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b4814284-3323-4537-bfe4-a367d452dd38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:31.134525 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b4814284-3323-4537-bfe4-a367d452dd38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:31.136314 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b4814284-3323-4537-bfe4-a367d452dd38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:31.137741 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b4814284-3323-4537-bfe4-a367d452dd38 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1738 microversion: 2.20 time: 0.171199 Feb 21 04:23:31.138721 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 497/985] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:30 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:32.157978 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fb6b32ca-c40a-452c-936e-caff04a71021 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:32.159233 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fb6b32ca-c40a-452c-936e-caff04a71021 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:32.166204 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb6b32ca-c40a-452c-936e-caff04a71021 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:32.166843 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb6b32ca-c40a-452c-936e-caff04a71021 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:32.167625 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb6b32ca-c40a-452c-936e-caff04a71021 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:32.168056 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fb6b32ca-c40a-452c-936e-caff04a71021 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:32.310318 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fb6b32ca-c40a-452c-936e-caff04a71021 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:32.319127 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fb6b32ca-c40a-452c-936e-caff04a71021 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:32.320605 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fb6b32ca-c40a-452c-936e-caff04a71021 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:32.321894 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fb6b32ca-c40a-452c-936e-caff04a71021 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1738 microversion: 2.20 time: 0.168403 Feb 21 04:23:32.322615 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 489/986] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:32 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:33.340573 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8f91840a-08e1-430c-b98c-5f00ac001ddf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:33.341183 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-8f91840a-08e1-430c-b98c-5f00ac001ddf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:33.347462 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8f91840a-08e1-430c-b98c-5f00ac001ddf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:33.348125 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8f91840a-08e1-430c-b98c-5f00ac001ddf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:33.349113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8f91840a-08e1-430c-b98c-5f00ac001ddf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:33.349548 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8f91840a-08e1-430c-b98c-5f00ac001ddf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:33.492685 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8f91840a-08e1-430c-b98c-5f00ac001ddf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:33.500436 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8f91840a-08e1-430c-b98c-5f00ac001ddf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:33.501967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8f91840a-08e1-430c-b98c-5f00ac001ddf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:33.503131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-8f91840a-08e1-430c-b98c-5f00ac001ddf tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1738 microversion: 2.20 time: 0.166286 Feb 21 04:23:33.503690 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 498/987] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:33 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:34.521843 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-eeb5b02a-3dc6-4afe-91ce-3fa648029d76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:34.522385 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-eeb5b02a-3dc6-4afe-91ce-3fa648029d76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:34.529337 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-eeb5b02a-3dc6-4afe-91ce-3fa648029d76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:34.529865 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-eeb5b02a-3dc6-4afe-91ce-3fa648029d76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:34.530724 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-eeb5b02a-3dc6-4afe-91ce-3fa648029d76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:34.531234 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-eeb5b02a-3dc6-4afe-91ce-3fa648029d76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:34.674317 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-eeb5b02a-3dc6-4afe-91ce-3fa648029d76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:34.682737 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-eeb5b02a-3dc6-4afe-91ce-3fa648029d76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:34.684239 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-eeb5b02a-3dc6-4afe-91ce-3fa648029d76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:34.685428 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-eeb5b02a-3dc6-4afe-91ce-3fa648029d76 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1738 microversion: 2.20 time: 0.167439 Feb 21 04:23:34.696110 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 490/988] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:34 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:35.703697 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ab6062d8-9751-40ad-a5c1-c9178125f32b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:35.704867 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ab6062d8-9751-40ad-a5c1-c9178125f32b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:35.711908 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ab6062d8-9751-40ad-a5c1-c9178125f32b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:35.712358 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ab6062d8-9751-40ad-a5c1-c9178125f32b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:35.713164 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ab6062d8-9751-40ad-a5c1-c9178125f32b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:35.713603 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ab6062d8-9751-40ad-a5c1-c9178125f32b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:35.863831 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ab6062d8-9751-40ad-a5c1-c9178125f32b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:35.872866 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ab6062d8-9751-40ad-a5c1-c9178125f32b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:35.874494 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ab6062d8-9751-40ad-a5c1-c9178125f32b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:35.875668 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ab6062d8-9751-40ad-a5c1-c9178125f32b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1738 microversion: 2.20 time: 0.176270 Feb 21 04:23:35.886072 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 499/989] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:35 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:36.896694 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4888621d-8c1b-4372-b1d8-b6c90fbb575b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:36.896694 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4888621d-8c1b-4372-b1d8-b6c90fbb575b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:36.902729 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4888621d-8c1b-4372-b1d8-b6c90fbb575b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:36.903431 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4888621d-8c1b-4372-b1d8-b6c90fbb575b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:36.904215 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4888621d-8c1b-4372-b1d8-b6c90fbb575b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:36.904659 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4888621d-8c1b-4372-b1d8-b6c90fbb575b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:37.044013 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4888621d-8c1b-4372-b1d8-b6c90fbb575b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:37.052377 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4888621d-8c1b-4372-b1d8-b6c90fbb575b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:37.053899 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4888621d-8c1b-4372-b1d8-b6c90fbb575b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:37.055112 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4888621d-8c1b-4372-b1d8-b6c90fbb575b tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1738 microversion: 2.20 time: 0.164135 Feb 21 04:23:37.055686 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 491/990] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:36 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:38.074187 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4edb2909-ecd7-4faa-9434-38a8dabc3c43 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:38.074752 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4edb2909-ecd7-4faa-9434-38a8dabc3c43 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:38.081287 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4edb2909-ecd7-4faa-9434-38a8dabc3c43 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:38.081760 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4edb2909-ecd7-4faa-9434-38a8dabc3c43 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:38.082541 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4edb2909-ecd7-4faa-9434-38a8dabc3c43 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:38.082977 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4edb2909-ecd7-4faa-9434-38a8dabc3c43 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:38.232262 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4edb2909-ecd7-4faa-9434-38a8dabc3c43 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:38.242359 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4edb2909-ecd7-4faa-9434-38a8dabc3c43 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:38.244263 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4edb2909-ecd7-4faa-9434-38a8dabc3c43 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:38.245482 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4edb2909-ecd7-4faa-9434-38a8dabc3c43 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1738 microversion: 2.20 time: 0.175608 Feb 21 04:23:38.246188 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 500/991] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:38 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:39.263462 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-94e3072f-793e-46cd-923b-50e0a4159950 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:39.264068 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-94e3072f-793e-46cd-923b-50e0a4159950 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:39.270648 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-94e3072f-793e-46cd-923b-50e0a4159950 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:39.271093 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-94e3072f-793e-46cd-923b-50e0a4159950 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:39.271867 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-94e3072f-793e-46cd-923b-50e0a4159950 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:39.272293 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-94e3072f-793e-46cd-923b-50e0a4159950 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:39.423127 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-94e3072f-793e-46cd-923b-50e0a4159950 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:39.431982 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-94e3072f-793e-46cd-923b-50e0a4159950 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:39.433510 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-94e3072f-793e-46cd-923b-50e0a4159950 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:39.434682 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-94e3072f-793e-46cd-923b-50e0a4159950 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1738 microversion: 2.20 time: 0.174918 Feb 21 04:23:39.435240 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 492/992] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:39 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:40.453308 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-35347e2b-c942-44cc-8dff-ad1e909d6531 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:40.453914 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-35347e2b-c942-44cc-8dff-ad1e909d6531 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:40.460828 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-35347e2b-c942-44cc-8dff-ad1e909d6531 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:40.461507 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-35347e2b-c942-44cc-8dff-ad1e909d6531 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:40.462485 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-35347e2b-c942-44cc-8dff-ad1e909d6531 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:40.462921 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-35347e2b-c942-44cc-8dff-ad1e909d6531 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:40.619566 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-35347e2b-c942-44cc-8dff-ad1e909d6531 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:40.628266 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-35347e2b-c942-44cc-8dff-ad1e909d6531 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:40.629827 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-35347e2b-c942-44cc-8dff-ad1e909d6531 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:40.630991 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-35347e2b-c942-44cc-8dff-ad1e909d6531 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1738 microversion: 2.20 time: 0.181461 Feb 21 04:23:40.631552 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 501/993] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:40 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:41.653886 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-739a3d55-271e-4957-9e51-994d6523a5f6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:41.654494 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-739a3d55-271e-4957-9e51-994d6523a5f6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:41.660758 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-739a3d55-271e-4957-9e51-994d6523a5f6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:41.661210 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-739a3d55-271e-4957-9e51-994d6523a5f6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:41.661982 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-739a3d55-271e-4957-9e51-994d6523a5f6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:41.662416 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-739a3d55-271e-4957-9e51-994d6523a5f6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:41.799193 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-739a3d55-271e-4957-9e51-994d6523a5f6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:41.807409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-739a3d55-271e-4957-9e51-994d6523a5f6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:41.808939 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-739a3d55-271e-4957-9e51-994d6523a5f6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:41.810087 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-739a3d55-271e-4957-9e51-994d6523a5f6 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1738 microversion: 2.20 time: 0.160139 Feb 21 04:23:41.810654 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 493/994] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:41 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:42.827701 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b8eb6cd8-0533-4651-991d-604daababe83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:42.828336 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b8eb6cd8-0533-4651-991d-604daababe83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:42.834589 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b8eb6cd8-0533-4651-991d-604daababe83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:42.835047 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b8eb6cd8-0533-4651-991d-604daababe83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:42.835837 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b8eb6cd8-0533-4651-991d-604daababe83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:42.836274 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b8eb6cd8-0533-4651-991d-604daababe83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:42.968539 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b8eb6cd8-0533-4651-991d-604daababe83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:42.976119 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b8eb6cd8-0533-4651-991d-604daababe83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:42.977635 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b8eb6cd8-0533-4651-991d-604daababe83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:42.978779 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b8eb6cd8-0533-4651-991d-604daababe83 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1720 microversion: 2.20 time: 0.154876 Feb 21 04:23:42.979394 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 502/995] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:42 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:43.996429 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4ec73164-7a32-4255-8613-31fbc24495dc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:43.997066 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4ec73164-7a32-4255-8613-31fbc24495dc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:44.003306 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4ec73164-7a32-4255-8613-31fbc24495dc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:44.003752 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4ec73164-7a32-4255-8613-31fbc24495dc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:44.004531 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4ec73164-7a32-4255-8613-31fbc24495dc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:44.004989 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4ec73164-7a32-4255-8613-31fbc24495dc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:44.131641 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4ec73164-7a32-4255-8613-31fbc24495dc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:44.139284 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4ec73164-7a32-4255-8613-31fbc24495dc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:44.140815 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4ec73164-7a32-4255-8613-31fbc24495dc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:44.141963 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4ec73164-7a32-4255-8613-31fbc24495dc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1720 microversion: 2.20 time: 0.149263 Feb 21 04:23:44.142518 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 494/996] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:43 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:44.668471 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-09f056b6-daac-4155-bae8-e07662571dd3 req-24847931-61d3-46d8-868a-b82fbb4e9475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6ae5e7-0c3c-4a17-b846-0a427a7e609d", "name": "network-vif-unplugged", "status": "completed", "tag": "1f9abb1e-20ab-4409-9680-aa349073bc5e"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:23:44.670050 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:23:44.670050 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:23:44.678109 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-09f056b6-daac-4155-bae8-e07662571dd3 req-24847931-61d3-46d8-868a-b82fbb4e9475 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:44.678695 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-09f056b6-daac-4155-bae8-e07662571dd3 req-24847931-61d3-46d8-868a-b82fbb4e9475 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:44.691180 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-09f056b6-daac-4155-bae8-e07662571dd3 req-24847931-61d3-46d8-868a-b82fbb4e9475 service nova] Creating event network-vif-unplugged:1f9abb1e-20ab-4409-9680-aa349073bc5e for instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d on hv-cinder-77398 Feb 21 04:23:44.696846 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-09f056b6-daac-4155-bae8-e07662571dd3 req-24847931-61d3-46d8-868a-b82fbb4e9475 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032676 Feb 21 04:23:44.697597 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 503/997] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:23:45.160527 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-1717500c-924e-4e1f-ab21-00cc06d9cbb8 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:45.161171 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-1717500c-924e-4e1f-ab21-00cc06d9cbb8 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:45.167927 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1717500c-924e-4e1f-ab21-00cc06d9cbb8 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:45.168377 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1717500c-924e-4e1f-ab21-00cc06d9cbb8 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:45.169189 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1717500c-924e-4e1f-ab21-00cc06d9cbb8 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:45.169625 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-1717500c-924e-4e1f-ab21-00cc06d9cbb8 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:45.301717 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1717500c-924e-4e1f-ab21-00cc06d9cbb8 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:45.309993 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1717500c-924e-4e1f-ab21-00cc06d9cbb8 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:45.311779 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-1717500c-924e-4e1f-ab21-00cc06d9cbb8 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:45.313056 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-1717500c-924e-4e1f-ab21-00cc06d9cbb8 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1663 microversion: 2.20 time: 0.156197 Feb 21 04:23:45.313612 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 495/998] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:45 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 04:23:45.330703 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ea2df208-fec6-4424-9b7c-3a818ccc06ae tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba72f68f-5b73-4717-a3df-ceb28b01bc2d"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:23:45.331830 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ea2df208-fec6-4424-9b7c-3a818ccc06ae tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:45.338268 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ea2df208-fec6-4424-9b7c-3a818ccc06ae tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:45.338710 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ea2df208-fec6-4424-9b7c-3a818ccc06ae tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:45.339475 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ea2df208-fec6-4424-9b7c-3a818ccc06ae tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:45.339903 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ea2df208-fec6-4424-9b7c-3a818ccc06ae tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:45.578633 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ea2df208-fec6-4424-9b7c-3a818ccc06ae tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "POST /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.251946 Feb 21 04:23:45.579220 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 504/999] 10.222.0.10 () {62 vars in 1363 bytes} [Mon Feb 21 04:23:45 2022] POST /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/os-volume_attachments => generated 188 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 04:23:45.687391 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-db11ee79-e584-4dc3-807e-4c1fd994e3cc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:45.687885 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-db11ee79-e584-4dc3-807e-4c1fd994e3cc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:45.693710 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-db11ee79-e584-4dc3-807e-4c1fd994e3cc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:45.694160 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-db11ee79-e584-4dc3-807e-4c1fd994e3cc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:45.694938 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-db11ee79-e584-4dc3-807e-4c1fd994e3cc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:45.695372 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-db11ee79-e584-4dc3-807e-4c1fd994e3cc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:45.928713 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-db11ee79-e584-4dc3-807e-4c1fd994e3cc tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "DELETE /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/os-volume_attachments/ba72f68f-5b73-4717-a3df-ceb28b01bc2d" status: 202 len: 0 microversion: 2.20 time: 0.245152 Feb 21 04:23:45.929246 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 496/1000] 10.222.0.10 () {60 vars in 1456 bytes} [Mon Feb 21 04:23:45 2022] DELETE /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/os-volume_attachments/ba72f68f-5b73-4717-a3df-ceb28b01bc2d => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:23:45.981618 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0a73db7e-9b60-4079-93fd-1ed95e7a9a70 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:23:45.982220 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0a73db7e-9b60-4079-93fd-1ed95e7a9a70 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:45.988190 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0a73db7e-9b60-4079-93fd-1ed95e7a9a70 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:45.988651 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0a73db7e-9b60-4079-93fd-1ed95e7a9a70 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:45.989424 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0a73db7e-9b60-4079-93fd-1ed95e7a9a70 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:45.989856 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0a73db7e-9b60-4079-93fd-1ed95e7a9a70 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:46.066088 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0a73db7e-9b60-4079-93fd-1ed95e7a9a70 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "POST /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/action" status: 202 len: 0 microversion: 2.20 time: 0.088724 Feb 21 04:23:46.066887 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 505/1001] 10.222.0.10 () {62 vars in 1318 bytes} [Mon Feb 21 04:23:45 2022] POST /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:23:46.075437 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d30a7fa5-f620-4fe7-9d26-fb7f7b2b8fed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:46.076141 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d30a7fa5-f620-4fe7-9d26-fb7f7b2b8fed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:46.082064 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d30a7fa5-f620-4fe7-9d26-fb7f7b2b8fed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:46.082503 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d30a7fa5-f620-4fe7-9d26-fb7f7b2b8fed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:46.083272 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d30a7fa5-f620-4fe7-9d26-fb7f7b2b8fed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:46.083701 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d30a7fa5-f620-4fe7-9d26-fb7f7b2b8fed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:46.215066 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d30a7fa5-f620-4fe7-9d26-fb7f7b2b8fed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:46.222720 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d30a7fa5-f620-4fe7-9d26-fb7f7b2b8fed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:46.224211 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d30a7fa5-f620-4fe7-9d26-fb7f7b2b8fed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:46.225572 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d30a7fa5-f620-4fe7-9d26-fb7f7b2b8fed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1671 microversion: 2.20 time: 0.153885 Feb 21 04:23:46.226130 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 497/1002] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:46 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:47.245436 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0001b304-fb0f-4e03-9dc1-b079d7b36b93 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:47.246034 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0001b304-fb0f-4e03-9dc1-b079d7b36b93 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:47.251797 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0001b304-fb0f-4e03-9dc1-b079d7b36b93 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:47.252241 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0001b304-fb0f-4e03-9dc1-b079d7b36b93 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:47.253032 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0001b304-fb0f-4e03-9dc1-b079d7b36b93 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:47.253463 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0001b304-fb0f-4e03-9dc1-b079d7b36b93 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:47.471065 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0001b304-fb0f-4e03-9dc1-b079d7b36b93 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:47.479625 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0001b304-fb0f-4e03-9dc1-b079d7b36b93 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:47.481147 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0001b304-fb0f-4e03-9dc1-b079d7b36b93 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:47.482301 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0001b304-fb0f-4e03-9dc1-b079d7b36b93 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.241754 Feb 21 04:23:47.482856 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 506/1003] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:47 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:48.503305 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4d2daf13-b9b5-4172-a254-bf9fe0cebe61 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:48.505584 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4d2daf13-b9b5-4172-a254-bf9fe0cebe61 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:48.513156 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4d2daf13-b9b5-4172-a254-bf9fe0cebe61 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:48.513677 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4d2daf13-b9b5-4172-a254-bf9fe0cebe61 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:48.514572 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4d2daf13-b9b5-4172-a254-bf9fe0cebe61 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:48.515196 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4d2daf13-b9b5-4172-a254-bf9fe0cebe61 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:48.676154 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4d2daf13-b9b5-4172-a254-bf9fe0cebe61 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:48.684872 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4d2daf13-b9b5-4172-a254-bf9fe0cebe61 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:48.686371 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4d2daf13-b9b5-4172-a254-bf9fe0cebe61 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:48.687551 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4d2daf13-b9b5-4172-a254-bf9fe0cebe61 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.189379 Feb 21 04:23:48.688116 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 498/1004] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:48 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:49.707226 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ce8bba27-4ef2-4fce-a4b7-a5fbaacb3e65 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:49.707877 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ce8bba27-4ef2-4fce-a4b7-a5fbaacb3e65 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:49.714788 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ce8bba27-4ef2-4fce-a4b7-a5fbaacb3e65 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:49.715232 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ce8bba27-4ef2-4fce-a4b7-a5fbaacb3e65 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:49.716013 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ce8bba27-4ef2-4fce-a4b7-a5fbaacb3e65 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:49.716444 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ce8bba27-4ef2-4fce-a4b7-a5fbaacb3e65 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:49.859338 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ce8bba27-4ef2-4fce-a4b7-a5fbaacb3e65 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:49.867245 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ce8bba27-4ef2-4fce-a4b7-a5fbaacb3e65 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:49.869259 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ce8bba27-4ef2-4fce-a4b7-a5fbaacb3e65 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:49.870710 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ce8bba27-4ef2-4fce-a4b7-a5fbaacb3e65 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.167322 Feb 21 04:23:49.871263 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 507/1005] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:49 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:50.892964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0d41ff3c-d2d1-43f0-8fb6-b94fe340f227 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:50.893674 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0d41ff3c-d2d1-43f0-8fb6-b94fe340f227 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:50.900261 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0d41ff3c-d2d1-43f0-8fb6-b94fe340f227 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:50.900773 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0d41ff3c-d2d1-43f0-8fb6-b94fe340f227 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:50.901629 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0d41ff3c-d2d1-43f0-8fb6-b94fe340f227 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:50.902067 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0d41ff3c-d2d1-43f0-8fb6-b94fe340f227 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:51.043046 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0d41ff3c-d2d1-43f0-8fb6-b94fe340f227 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:51.051762 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0d41ff3c-d2d1-43f0-8fb6-b94fe340f227 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:51.053294 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0d41ff3c-d2d1-43f0-8fb6-b94fe340f227 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:51.054468 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0d41ff3c-d2d1-43f0-8fb6-b94fe340f227 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.166186 Feb 21 04:23:51.063968 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 499/1006] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:50 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:52.074133 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-2430caeb-2009-4c68-a65f-32a1a911c54f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:52.074829 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-2430caeb-2009-4c68-a65f-32a1a911c54f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:52.081444 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2430caeb-2009-4c68-a65f-32a1a911c54f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:52.081894 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2430caeb-2009-4c68-a65f-32a1a911c54f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:52.082677 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2430caeb-2009-4c68-a65f-32a1a911c54f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:52.083103 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2430caeb-2009-4c68-a65f-32a1a911c54f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:52.222346 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-2430caeb-2009-4c68-a65f-32a1a911c54f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:52.231192 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-2430caeb-2009-4c68-a65f-32a1a911c54f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:52.232663 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-2430caeb-2009-4c68-a65f-32a1a911c54f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:52.234266 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-2430caeb-2009-4c68-a65f-32a1a911c54f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.163857 Feb 21 04:23:52.235167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 508/1007] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:52 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:53.253453 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e984240b-7b3d-4c02-af41-26b171496649 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:53.254089 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e984240b-7b3d-4c02-af41-26b171496649 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:53.260984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e984240b-7b3d-4c02-af41-26b171496649 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:53.261424 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e984240b-7b3d-4c02-af41-26b171496649 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:53.262201 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e984240b-7b3d-4c02-af41-26b171496649 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:53.262630 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e984240b-7b3d-4c02-af41-26b171496649 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:53.407547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e984240b-7b3d-4c02-af41-26b171496649 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:53.415401 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e984240b-7b3d-4c02-af41-26b171496649 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:53.416910 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e984240b-7b3d-4c02-af41-26b171496649 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:53.418048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e984240b-7b3d-4c02-af41-26b171496649 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.169329 Feb 21 04:23:53.418617 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 500/1008] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:53 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:54.438196 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b5a1ceda-18b7-4f50-a485-af67f04d2eb7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:54.438896 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b5a1ceda-18b7-4f50-a485-af67f04d2eb7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:54.445712 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b5a1ceda-18b7-4f50-a485-af67f04d2eb7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:54.446170 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b5a1ceda-18b7-4f50-a485-af67f04d2eb7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:54.446964 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b5a1ceda-18b7-4f50-a485-af67f04d2eb7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:54.447401 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b5a1ceda-18b7-4f50-a485-af67f04d2eb7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:54.582849 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b5a1ceda-18b7-4f50-a485-af67f04d2eb7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:54.592350 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b5a1ceda-18b7-4f50-a485-af67f04d2eb7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:54.594059 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b5a1ceda-18b7-4f50-a485-af67f04d2eb7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:54.595476 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b5a1ceda-18b7-4f50-a485-af67f04d2eb7 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.161444 Feb 21 04:23:54.596111 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 509/1009] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:54 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:55.614365 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-34dd44b5-e5fe-4d3e-8cd6-93ecb6271d1c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:55.615082 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-34dd44b5-e5fe-4d3e-8cd6-93ecb6271d1c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:55.622088 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-34dd44b5-e5fe-4d3e-8cd6-93ecb6271d1c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:55.622540 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-34dd44b5-e5fe-4d3e-8cd6-93ecb6271d1c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:55.623326 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-34dd44b5-e5fe-4d3e-8cd6-93ecb6271d1c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:55.623760 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-34dd44b5-e5fe-4d3e-8cd6-93ecb6271d1c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:55.786122 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-34dd44b5-e5fe-4d3e-8cd6-93ecb6271d1c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:55.794817 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-34dd44b5-e5fe-4d3e-8cd6-93ecb6271d1c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:55.796290 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-34dd44b5-e5fe-4d3e-8cd6-93ecb6271d1c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:55.797492 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-34dd44b5-e5fe-4d3e-8cd6-93ecb6271d1c tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.186921 Feb 21 04:23:55.798250 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 501/1010] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:55 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:56.816851 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e5c371fa-c31a-49c7-8c31-adef19e49291 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:56.817458 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e5c371fa-c31a-49c7-8c31-adef19e49291 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:56.824229 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e5c371fa-c31a-49c7-8c31-adef19e49291 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:56.824703 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e5c371fa-c31a-49c7-8c31-adef19e49291 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:56.825490 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e5c371fa-c31a-49c7-8c31-adef19e49291 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:56.825906 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e5c371fa-c31a-49c7-8c31-adef19e49291 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:56.957596 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e5c371fa-c31a-49c7-8c31-adef19e49291 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:56.965219 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e5c371fa-c31a-49c7-8c31-adef19e49291 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:56.966718 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e5c371fa-c31a-49c7-8c31-adef19e49291 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:56.967870 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e5c371fa-c31a-49c7-8c31-adef19e49291 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.154729 Feb 21 04:23:56.968480 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 510/1011] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:56 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:57.985397 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5a6e811b-771f-4255-b1c1-75b923ba19fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:57.986005 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5a6e811b-771f-4255-b1c1-75b923ba19fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:57.992235 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a6e811b-771f-4255-b1c1-75b923ba19fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:57.992723 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a6e811b-771f-4255-b1c1-75b923ba19fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:57.993498 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a6e811b-771f-4255-b1c1-75b923ba19fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:57.993934 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a6e811b-771f-4255-b1c1-75b923ba19fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:58.127458 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5a6e811b-771f-4255-b1c1-75b923ba19fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:58.137318 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5a6e811b-771f-4255-b1c1-75b923ba19fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:58.138795 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5a6e811b-771f-4255-b1c1-75b923ba19fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:58.139989 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5a6e811b-771f-4255-b1c1-75b923ba19fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.158231 Feb 21 04:23:58.140561 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 502/1012] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:57 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:23:59.157980 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ce418dcb-1017-4118-82a9-e8e2ccd5431f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:23:59.158585 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ce418dcb-1017-4118-82a9-e8e2ccd5431f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:23:59.165428 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ce418dcb-1017-4118-82a9-e8e2ccd5431f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:59.165875 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ce418dcb-1017-4118-82a9-e8e2ccd5431f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:59.166641 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ce418dcb-1017-4118-82a9-e8e2ccd5431f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:23:59.167073 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ce418dcb-1017-4118-82a9-e8e2ccd5431f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:23:59.298587 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ce418dcb-1017-4118-82a9-e8e2ccd5431f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:59.306141 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ce418dcb-1017-4118-82a9-e8e2ccd5431f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:59.307627 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ce418dcb-1017-4118-82a9-e8e2ccd5431f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:23:59.308798 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ce418dcb-1017-4118-82a9-e8e2ccd5431f tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.154508 Feb 21 04:23:59.309353 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 511/1013] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:23:59 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:24:00.327523 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0d7fc8c0-9571-4430-a52b-becd9c03e3fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:24:00.328122 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0d7fc8c0-9571-4430-a52b-becd9c03e3fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:24:00.334327 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0d7fc8c0-9571-4430-a52b-becd9c03e3fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:00.334773 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0d7fc8c0-9571-4430-a52b-becd9c03e3fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:00.335546 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0d7fc8c0-9571-4430-a52b-becd9c03e3fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:00.336473 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0d7fc8c0-9571-4430-a52b-becd9c03e3fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:00.464314 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0d7fc8c0-9571-4430-a52b-becd9c03e3fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:00.471814 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0d7fc8c0-9571-4430-a52b-becd9c03e3fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:00.473329 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0d7fc8c0-9571-4430-a52b-becd9c03e3fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:00.474460 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0d7fc8c0-9571-4430-a52b-becd9c03e3fa tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.150673 Feb 21 04:24:00.475016 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 503/1014] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:24:00 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:24:01.492503 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-029b2af4-33c8-40ef-b469-c4ceaaa20713 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:24:01.493065 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-029b2af4-33c8-40ef-b469-c4ceaaa20713 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:24:01.499167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-029b2af4-33c8-40ef-b469-c4ceaaa20713 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:01.499609 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-029b2af4-33c8-40ef-b469-c4ceaaa20713 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:01.500371 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-029b2af4-33c8-40ef-b469-c4ceaaa20713 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:01.500829 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-029b2af4-33c8-40ef-b469-c4ceaaa20713 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:01.628709 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-029b2af4-33c8-40ef-b469-c4ceaaa20713 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:01.636415 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-029b2af4-33c8-40ef-b469-c4ceaaa20713 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:01.637962 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-029b2af4-33c8-40ef-b469-c4ceaaa20713 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:01.639116 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-029b2af4-33c8-40ef-b469-c4ceaaa20713 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.150980 Feb 21 04:24:01.639673 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 512/1015] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:24:01 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:24:02.657475 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-35203b17-e6a2-420b-80e1-73bbd0461323 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:24:02.658080 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-35203b17-e6a2-420b-80e1-73bbd0461323 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:24:02.664954 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35203b17-e6a2-420b-80e1-73bbd0461323 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:02.665402 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35203b17-e6a2-420b-80e1-73bbd0461323 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:02.666172 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35203b17-e6a2-420b-80e1-73bbd0461323 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:02.666604 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-35203b17-e6a2-420b-80e1-73bbd0461323 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:02.798745 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-35203b17-e6a2-420b-80e1-73bbd0461323 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:02.807077 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-35203b17-e6a2-420b-80e1-73bbd0461323 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:02.808528 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-35203b17-e6a2-420b-80e1-73bbd0461323 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:02.810863 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-35203b17-e6a2-420b-80e1-73bbd0461323 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.155956 Feb 21 04:24:02.811427 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 504/1016] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:24:02 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:24:03.828704 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d8eee6a0-5132-4ea0-bdb5-080a4cd751f5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:24:03.829312 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d8eee6a0-5132-4ea0-bdb5-080a4cd751f5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:24:03.835563 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d8eee6a0-5132-4ea0-bdb5-080a4cd751f5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:03.836614 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d8eee6a0-5132-4ea0-bdb5-080a4cd751f5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:03.837520 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d8eee6a0-5132-4ea0-bdb5-080a4cd751f5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:03.837853 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d8eee6a0-5132-4ea0-bdb5-080a4cd751f5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:04.013210 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d8eee6a0-5132-4ea0-bdb5-080a4cd751f5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:04.020810 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d8eee6a0-5132-4ea0-bdb5-080a4cd751f5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:04.022239 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d8eee6a0-5132-4ea0-bdb5-080a4cd751f5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:04.023984 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d8eee6a0-5132-4ea0-bdb5-080a4cd751f5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.198405 Feb 21 04:24:04.024532 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 513/1017] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:24:03 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:24:04.858375 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-5f9fdc7e-d8b8-4daa-bc20-78c8a6b14e09 req-ebf2e540-e4d2-4f77-a6f3-14bf33c81581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6ae5e7-0c3c-4a17-b846-0a427a7e609d", "name": "network-vif-plugged", "status": "completed", "tag": "1f9abb1e-20ab-4409-9680-aa349073bc5e"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:24:04.860007 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:24:04.860007 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:24:04.867456 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-5f9fdc7e-d8b8-4daa-bc20-78c8a6b14e09 req-ebf2e540-e4d2-4f77-a6f3-14bf33c81581 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:04.867901 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-5f9fdc7e-d8b8-4daa-bc20-78c8a6b14e09 req-ebf2e540-e4d2-4f77-a6f3-14bf33c81581 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:04.878584 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-5f9fdc7e-d8b8-4daa-bc20-78c8a6b14e09 req-ebf2e540-e4d2-4f77-a6f3-14bf33c81581 service nova] Creating event network-vif-plugged:1f9abb1e-20ab-4409-9680-aa349073bc5e for instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d on hv-cinder-77398 Feb 21 04:24:04.884147 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-5f9fdc7e-d8b8-4daa-bc20-78c8a6b14e09 req-ebf2e540-e4d2-4f77-a6f3-14bf33c81581 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029059 Feb 21 04:24:04.885075 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 505/1018] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:24:05.042681 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-56708a18-3c1c-4254-b2c8-8b70843563f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:24:05.043244 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-56708a18-3c1c-4254-b2c8-8b70843563f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:24:05.049458 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-56708a18-3c1c-4254-b2c8-8b70843563f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:05.049917 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-56708a18-3c1c-4254-b2c8-8b70843563f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:05.050701 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-56708a18-3c1c-4254-b2c8-8b70843563f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:05.051138 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-56708a18-3c1c-4254-b2c8-8b70843563f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:05.204749 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-56708a18-3c1c-4254-b2c8-8b70843563f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:05.213151 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-56708a18-3c1c-4254-b2c8-8b70843563f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:05.214666 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-56708a18-3c1c-4254-b2c8-8b70843563f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:05.215820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-56708a18-3c1c-4254-b2c8-8b70843563f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.177561 Feb 21 04:24:05.216405 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 514/1019] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:24:05 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:24:06.234508 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-afa1be80-c0a4-44ec-9f1e-2397d7b109e0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:24:06.235214 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-afa1be80-c0a4-44ec-9f1e-2397d7b109e0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:24:06.241263 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-afa1be80-c0a4-44ec-9f1e-2397d7b109e0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:06.241713 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-afa1be80-c0a4-44ec-9f1e-2397d7b109e0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:06.243105 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-afa1be80-c0a4-44ec-9f1e-2397d7b109e0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:06.243541 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-afa1be80-c0a4-44ec-9f1e-2397d7b109e0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:06.425680 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-afa1be80-c0a4-44ec-9f1e-2397d7b109e0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:06.433468 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-afa1be80-c0a4-44ec-9f1e-2397d7b109e0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:06.434961 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-afa1be80-c0a4-44ec-9f1e-2397d7b109e0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:06.436108 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-afa1be80-c0a4-44ec-9f1e-2397d7b109e0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1729 microversion: 2.20 time: 0.206083 Feb 21 04:24:06.436695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 506/1020] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:24:06 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:24:07.453803 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1a5c4ba2-3abe-4508-9b0e-0e7a5c792ed1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:24:07.454416 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1a5c4ba2-3abe-4508-9b0e-0e7a5c792ed1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:24:07.460652 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a5c4ba2-3abe-4508-9b0e-0e7a5c792ed1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:07.461113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a5c4ba2-3abe-4508-9b0e-0e7a5c792ed1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:07.461889 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a5c4ba2-3abe-4508-9b0e-0e7a5c792ed1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:24:07.462332 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a5c4ba2-3abe-4508-9b0e-0e7a5c792ed1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:24:07.589734 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1a5c4ba2-3abe-4508-9b0e-0e7a5c792ed1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:07.597507 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1a5c4ba2-3abe-4508-9b0e-0e7a5c792ed1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:07.599024 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1a5c4ba2-3abe-4508-9b0e-0e7a5c792ed1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:24:07.600183 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1a5c4ba2-3abe-4508-9b0e-0e7a5c792ed1 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1716 microversion: 2.20 time: 0.150103 Feb 21 04:24:07.600766 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 515/1021] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:24:07 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:24:07.620902 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:24:07.621395 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: Mon Feb 21 04:24:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:24:18.765675 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:24:18.766211 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: Mon Feb 21 04:24:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:25:01.376887 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:25:01.377478 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: Mon Feb 21 04:25:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:25:03.268142 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-01b7e404-4e50-4324-85b0-453a737846ed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:03.269078 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-01b7e404-4e50-4324-85b0-453a737846ed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:03.276030 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-01b7e404-4e50-4324-85b0-453a737846ed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:03.276479 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-01b7e404-4e50-4324-85b0-453a737846ed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:03.277308 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-01b7e404-4e50-4324-85b0-453a737846ed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:03.277988 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-01b7e404-4e50-4324-85b0-453a737846ed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:03.306683 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-01b7e404-4e50-4324-85b0-453a737846ed tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042477 Feb 21 04:25:03.307222 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 507/1022] 10.222.0.10 () {60 vars in 1342 bytes} [Mon Feb 21 04:25:03 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:03.362543 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4c3b4bb5-7f2b-43c4-b6d4-6f13785cb9db tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:03.363050 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4c3b4bb5-7f2b-43c4-b6d4-6f13785cb9db tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:03.369406 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4c3b4bb5-7f2b-43c4-b6d4-6f13785cb9db tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:03.369858 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4c3b4bb5-7f2b-43c4-b6d4-6f13785cb9db tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:03.370641 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4c3b4bb5-7f2b-43c4-b6d4-6f13785cb9db tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:03.371080 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4c3b4bb5-7f2b-43c4-b6d4-6f13785cb9db tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:03.395370 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4c3b4bb5-7f2b-43c4-b6d4-6f13785cb9db tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Going to try to terminate instance {{(pid=116571) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:25:03.467412 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4c3b4bb5-7f2b-43c4-b6d4-6f13785cb9db tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "DELETE /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 204 len: 0 microversion: 2.20 time: 0.108391 Feb 21 04:25:03.468126 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 516/1023] 10.222.0.10 () {60 vars in 1279 bytes} [Mon Feb 21 04:25:03 2022] DELETE /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 04:25:03.477024 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-31357561-0656-46ed-b991-fe8bff802029 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:03.477889 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-31357561-0656-46ed-b991-fe8bff802029 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:03.483830 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-31357561-0656-46ed-b991-fe8bff802029 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:03.484273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-31357561-0656-46ed-b991-fe8bff802029 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:03.485078 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-31357561-0656-46ed-b991-fe8bff802029 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:03.485508 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-31357561-0656-46ed-b991-fe8bff802029 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:03.614444 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-31357561-0656-46ed-b991-fe8bff802029 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:03.622041 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-31357561-0656-46ed-b991-fe8bff802029 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:03.623521 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-31357561-0656-46ed-b991-fe8bff802029 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:03.624729 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-31357561-0656-46ed-b991-fe8bff802029 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1722 microversion: 2.20 time: 0.152126 Feb 21 04:25:03.625289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 508/1024] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:25:03 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:25:04.643267 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-45162bba-b68c-4da4-95f7-2341761bc5a4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:04.643969 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-45162bba-b68c-4da4-95f7-2341761bc5a4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:04.651023 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-45162bba-b68c-4da4-95f7-2341761bc5a4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:04.651475 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-45162bba-b68c-4da4-95f7-2341761bc5a4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:04.652246 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-45162bba-b68c-4da4-95f7-2341761bc5a4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:04.652702 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-45162bba-b68c-4da4-95f7-2341761bc5a4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:04.787674 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-45162bba-b68c-4da4-95f7-2341761bc5a4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:04.795392 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-45162bba-b68c-4da4-95f7-2341761bc5a4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:04.796904 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-45162bba-b68c-4da4-95f7-2341761bc5a4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:04.798056 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-45162bba-b68c-4da4-95f7-2341761bc5a4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1722 microversion: 2.20 time: 0.158866 Feb 21 04:25:04.798608 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 517/1025] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:25:04 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:25:05.816499 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-164e2cd3-c85e-4d68-8c8e-88beae577ff0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:05.817284 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-164e2cd3-c85e-4d68-8c8e-88beae577ff0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:05.823715 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-164e2cd3-c85e-4d68-8c8e-88beae577ff0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:05.824158 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-164e2cd3-c85e-4d68-8c8e-88beae577ff0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:05.824973 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-164e2cd3-c85e-4d68-8c8e-88beae577ff0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:05.825417 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-164e2cd3-c85e-4d68-8c8e-88beae577ff0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:05.993493 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-0fbcee39-fe9e-4034-9119-9a0a3874f61f req-3b268e74-2820-4fdd-bcca-89d1de62f94d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6ae5e7-0c3c-4a17-b846-0a427a7e609d", "name": "network-vif-deleted", "tag": "1f9abb1e-20ab-4409-9680-aa349073bc5e"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:25:05.995110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:25:05.995110 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:25:06.010607 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-0fbcee39-fe9e-4034-9119-9a0a3874f61f req-3b268e74-2820-4fdd-bcca-89d1de62f94d service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:06.011698 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-0fbcee39-fe9e-4034-9119-9a0a3874f61f req-3b268e74-2820-4fdd-bcca-89d1de62f94d service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:06.049376 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-0fbcee39-fe9e-4034-9119-9a0a3874f61f req-3b268e74-2820-4fdd-bcca-89d1de62f94d service nova] Creating event network-vif-deleted:1f9abb1e-20ab-4409-9680-aa349073bc5e for instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d on hv-cinder-77398 Feb 21 04:25:06.057576 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-0fbcee39-fe9e-4034-9119-9a0a3874f61f req-3b268e74-2820-4fdd-bcca-89d1de62f94d service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159122 Feb 21 04:25:06.058768 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 518/1026] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:25:06.173316 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-164e2cd3-c85e-4d68-8c8e-88beae577ff0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:06.181335 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-164e2cd3-c85e-4d68-8c8e-88beae577ff0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:06.182836 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-164e2cd3-c85e-4d68-8c8e-88beae577ff0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd2b57fa426940dc8de7e72944ad4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f9f8c7b6284a97b2c5ac5aee7f3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:06.183997 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-164e2cd3-c85e-4d68-8c8e-88beae577ff0 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 200 len: 1655 microversion: 2.20 time: 0.371257 Feb 21 04:25:06.184556 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 509/1027] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:25:05 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 1655 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 04:25:07.203464 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1a86240e-b7cb-4273-ace4-4bff85c249d9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:07.204148 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1a86240e-b7cb-4273-ace4-4bff85c249d9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:07.210684 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a86240e-b7cb-4273-ace4-4bff85c249d9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:07.211139 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a86240e-b7cb-4273-ace4-4bff85c249d9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:07.211882 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a86240e-b7cb-4273-ace4-4bff85c249d9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:07.212309 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1a86240e-b7cb-4273-ace4-4bff85c249d9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:07.225513 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-1a86240e-b7cb-4273-ace4-4bff85c249d9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] HTTP exception thrown: Instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d could not be found. Feb 21 04:25:07.226086 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1a86240e-b7cb-4273-ace4-4bff85c249d9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Returning 404 to user: Instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:25:07.226876 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1a86240e-b7cb-4273-ace4-4bff85c249d9 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 404 len: 111 microversion: 2.20 time: 0.027966 Feb 21 04:25:07.227385 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 519/1028] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:25:07 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 04:25:07.235974 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-33e6742c-931b-4281-9316-f0f76dd91895 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '.version_select at 0x7feee13ad280>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:07.258131 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-33e6742c-931b-4281-9316-f0f76dd91895 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-112505788" status: 204 len: 0 microversion: 2.20 time: 0.026383 Feb 21 04:25:07.258679 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 510/1029] 10.222.0.10 () {60 vars in 1258 bytes} [Mon Feb 21 04:25:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-112505788 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 04:25:08.988117 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-50bb6ca0-00eb-4f39-9546-c7c19b40f0f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:08.988619 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-50bb6ca0-00eb-4f39-9546-c7c19b40f0f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:08.994852 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-50bb6ca0-00eb-4f39-9546-c7c19b40f0f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:08.995302 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-50bb6ca0-00eb-4f39-9546-c7c19b40f0f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:08.996079 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-50bb6ca0-00eb-4f39-9546-c7c19b40f0f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:08.996517 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-50bb6ca0-00eb-4f39-9546-c7c19b40f0f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:09.009789 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-50bb6ca0-00eb-4f39-9546-c7c19b40f0f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] HTTP exception thrown: Instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d could not be found. Feb 21 04:25:09.010367 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-50bb6ca0-00eb-4f39-9546-c7c19b40f0f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Returning 404 to user: Instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:25:09.011176 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-50bb6ca0-00eb-4f39-9546-c7c19b40f0f4 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "DELETE /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 404 len: 111 microversion: 2.20 time: 0.026783 Feb 21 04:25:09.011691 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 520/1030] 10.222.0.10 () {60 vars in 1279 bytes} [Mon Feb 21 04:25:08 2022] DELETE /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 04:25:09.019869 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-543504c3-0670-465d-aedd-a0788214d6ff tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:09.020420 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-543504c3-0670-465d-aedd-a0788214d6ff tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: fd6ae5e7-0c3c-4a17-b846-0a427a7e609d] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:09.027963 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-543504c3-0670-465d-aedd-a0788214d6ff tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:09.028418 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-543504c3-0670-465d-aedd-a0788214d6ff tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:09.029217 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-543504c3-0670-465d-aedd-a0788214d6ff tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:09.029648 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-543504c3-0670-465d-aedd-a0788214d6ff tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:09.041953 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-543504c3-0670-465d-aedd-a0788214d6ff tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] HTTP exception thrown: Instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d could not be found. Feb 21 04:25:09.042522 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-543504c3-0670-465d-aedd-a0788214d6ff tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Returning 404 to user: Instance fd6ae5e7-0c3c-4a17-b846-0a427a7e609d could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:25:09.043318 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-543504c3-0670-465d-aedd-a0788214d6ff tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d" status: 404 len: 111 microversion: 2.20 time: 0.027807 Feb 21 04:25:09.043831 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 511/1031] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:25:09 2022] GET /compute/v2.1/servers/fd6ae5e7-0c3c-4a17-b846-0a427a7e609d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 21 04:25:10.168104 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-350631a0-88fd-47cf-964e-dfcba5084abb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:10.168600 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-350631a0-88fd-47cf-964e-dfcba5084abb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:10.174825 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-350631a0-88fd-47cf-964e-dfcba5084abb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:10.175279 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-350631a0-88fd-47cf-964e-dfcba5084abb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:10.176059 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-350631a0-88fd-47cf-964e-dfcba5084abb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:10.176498 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-350631a0-88fd-47cf-964e-dfcba5084abb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:10.189255 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-350631a0-88fd-47cf-964e-dfcba5084abb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] HTTP exception thrown: Instance c0c59a20-ff75-456f-99b3-070207d951d7 could not be found. Feb 21 04:25:10.189832 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-350631a0-88fd-47cf-964e-dfcba5084abb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Returning 404 to user: Instance c0c59a20-ff75-456f-99b3-070207d951d7 could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:25:10.190657 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-350631a0-88fd-47cf-964e-dfcba5084abb tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "DELETE /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 404 len: 111 microversion: 2.20 time: 0.026217 Feb 21 04:25:10.191145 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 521/1032] 10.222.0.10 () {60 vars in 1279 bytes} [Mon Feb 21 04:25:10 2022] DELETE /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 04:25:10.198779 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3080807e-bb54-453e-bd3d-22a559dfe3e5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:10.199383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3080807e-bb54-453e-bd3d-22a559dfe3e5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] [instance: c0c59a20-ff75-456f-99b3-070207d951d7] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:10.205518 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3080807e-bb54-453e-bd3d-22a559dfe3e5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:10.205967 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3080807e-bb54-453e-bd3d-22a559dfe3e5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:10.206737 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3080807e-bb54-453e-bd3d-22a559dfe3e5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:10.207170 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3080807e-bb54-453e-bd3d-22a559dfe3e5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:10.220152 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-3080807e-bb54-453e-bd3d-22a559dfe3e5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] HTTP exception thrown: Instance c0c59a20-ff75-456f-99b3-070207d951d7 could not be found. Feb 21 04:25:10.220748 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3080807e-bb54-453e-bd3d-22a559dfe3e5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] Returning 404 to user: Instance c0c59a20-ff75-456f-99b3-070207d951d7 could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:25:10.221546 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3080807e-bb54-453e-bd3d-22a559dfe3e5 tempest-AttachVolumeShelveTestJSON-466251447 tempest-AttachVolumeShelveTestJSON-466251447-project] 10.222.0.10 "GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7" status: 404 len: 111 microversion: 2.20 time: 0.026429 Feb 21 04:25:10.222052 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 512/1033] 10.222.0.10 () {60 vars in 1276 bytes} [Mon Feb 21 04:25:10 2022] GET /compute/v2.1/servers/c0c59a20-ff75-456f-99b3-070207d951d7 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 04:25:18.777012 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-62408cce-5184-4f14-82d3-dff49e86cd2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Action: 'create', calling method: .version_select at 0x7feee0e4a160>, body: {"keypair": {"name": "tempest-keypair-442477199"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:25:18.791390 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-62408cce-5184-4f14-82d3-dff49e86cd2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Getting quotas for project e95f468f72044118862b24027a3667e1. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:25:18.795375 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-62408cce-5184-4f14-82d3-dff49e86cd2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Getting quotas for user d165f2d03fdd43069795313e84816e72 and project e95f468f72044118862b24027a3667e1. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:25:19.210027 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-62408cce-5184-4f14-82d3-dff49e86cd2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Getting quotas for project e95f468f72044118862b24027a3667e1. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:25:19.214055 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-62408cce-5184-4f14-82d3-dff49e86cd2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Getting quotas for user d165f2d03fdd43069795313e84816e72 and project e95f468f72044118862b24027a3667e1. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:25:19.226740 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-62408cce-5184-4f14-82d3-dff49e86cd2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.566715 Feb 21 04:25:19.227324 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 522/1034] 10.222.0.10 () {60 vars in 1157 bytes} [Mon Feb 21 04:25:18 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:19.694130 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b2547c68-b6dd-4ce0-9cb3-3631c37c8882 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:19.695109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b2547c68-b6dd-4ce0-9cb3-3631c37c8882 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:19.701880 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b2547c68-b6dd-4ce0-9cb3-3631c37c8882 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:19.702675 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b2547c68-b6dd-4ce0-9cb3-3631c37c8882 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:19.704163 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b2547c68-b6dd-4ce0-9cb3-3631c37c8882 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:19.704820 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b2547c68-b6dd-4ce0-9cb3-3631c37c8882 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:19.732529 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b2547c68-b6dd-4ce0-9cb3-3631c37c8882 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Going to try to terminate instance {{(pid=116570) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:25:19.835414 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b2547c68-b6dd-4ce0-9cb3-3631c37c8882 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "DELETE /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 204 len: 0 microversion: 2.1 time: 0.145817 Feb 21 04:25:19.836367 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 513/1035] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:25:19 2022] DELETE /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:25:19.844591 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-581c85df-a239-44bb-859c-9dbcc8c71aac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:19.845868 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-581c85df-a239-44bb-859c-9dbcc8c71aac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:19.855714 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-581c85df-a239-44bb-859c-9dbcc8c71aac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:19.856577 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-581c85df-a239-44bb-859c-9dbcc8c71aac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:19.857905 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-581c85df-a239-44bb-859c-9dbcc8c71aac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:19.858607 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-581c85df-a239-44bb-859c-9dbcc8c71aac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:20.100657 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-581c85df-a239-44bb-859c-9dbcc8c71aac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:20.108320 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-581c85df-a239-44bb-859c-9dbcc8c71aac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1580 microversion: 2.1 time: 0.267815 Feb 21 04:25:20.109366 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 523/1036] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:19 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1580 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:25:20.581158 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-559096353", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c9062fa-aec5-48ac-8813-607eff1131a5"}], "security_groups": [{"name": "tempest-securitygroup--1951260661"}], "key_name": "tempest-keypair-442477199", "user_data": "}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:25:20.683944 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.network.neutron [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] validate_networks() for [('3c9062fa-aec5-48ac-8813-607eff1131a5', None, None, None, None, None)] {{(pid=116570) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:25:21.127536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a59d3c29-e0be-488b-94d3-796a22e5ae38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:21.128950 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a59d3c29-e0be-488b-94d3-796a22e5ae38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:21.143504 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Flavor limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:25:21.144518 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Image limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:25:21.145023 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Flavor pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:25:21.145430 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Image pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:25:21.146028 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:25:21.152323 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a59d3c29-e0be-488b-94d3-796a22e5ae38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:21.153416 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a59d3c29-e0be-488b-94d3-796a22e5ae38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:21.154454 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a59d3c29-e0be-488b-94d3-796a22e5ae38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:21.154953 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a59d3c29-e0be-488b-94d3-796a22e5ae38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:21.157937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:21.158389 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:21.159867 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:21.160312 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:21.177261 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Getting quotas for project e95f468f72044118862b24027a3667e1. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:25:21.181610 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Getting quotas for user d165f2d03fdd43069795313e84816e72 and project e95f468f72044118862b24027a3667e1. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:25:21.195327 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Going to run 1 instances... {{(pid=116570) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:25:21.199915 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:25:21.258590 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-57f2ce56-b339-4de3-8869-cc4eed0abc09 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.681824 Feb 21 04:25:21.259778 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 514/1037] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:25:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:25:21.269181 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9d965561-81aa-4ef0-8ab9-db2306dea9c7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:21.270085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9d965561-81aa-4ef0-8ab9-db2306dea9c7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:21.336602 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9d965561-81aa-4ef0-8ab9-db2306dea9c7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:21.345382 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9d965561-81aa-4ef0-8ab9-db2306dea9c7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1236 microversion: 2.1 time: 0.079427 Feb 21 04:25:21.347123 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 515/1038] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:21 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:25:21.352961 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a59d3c29-e0be-488b-94d3-796a22e5ae38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:21.360666 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a59d3c29-e0be-488b-94d3-796a22e5ae38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1580 microversion: 2.1 time: 0.237906 Feb 21 04:25:21.361769 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 524/1039] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:21 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1580 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:22.368769 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0db8195e-1700-4172-ac00-d7a9447a7c02 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:22.369405 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0db8195e-1700-4172-ac00-d7a9447a7c02 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:22.378105 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0db8195e-1700-4172-ac00-d7a9447a7c02 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:22.378553 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0db8195e-1700-4172-ac00-d7a9447a7c02 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:22.379347 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0db8195e-1700-4172-ac00-d7a9447a7c02 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:22.379777 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0db8195e-1700-4172-ac00-d7a9447a7c02 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:22.381464 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3b0159a5-b5e9-42f7-9b4a-e375a1810467 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:22.383259 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3b0159a5-b5e9-42f7-9b4a-e375a1810467 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:22.391925 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3b0159a5-b5e9-42f7-9b4a-e375a1810467 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:22.392570 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3b0159a5-b5e9-42f7-9b4a-e375a1810467 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:22.393654 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3b0159a5-b5e9-42f7-9b4a-e375a1810467 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:22.394298 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3b0159a5-b5e9-42f7-9b4a-e375a1810467 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:22.511864 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-3b0159a5-b5e9-42f7-9b4a-e375a1810467 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:22.515276 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0db8195e-1700-4172-ac00-d7a9447a7c02 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:22.525086 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0db8195e-1700-4172-ac00-d7a9447a7c02 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1288 microversion: 2.1 time: 0.165465 Feb 21 04:25:22.526297 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 516/1040] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:22 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1288 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:22.529028 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3b0159a5-b5e9-42f7-9b4a-e375a1810467 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 200 len: 1512 microversion: 2.1 time: 0.153298 Feb 21 04:25:22.530065 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 525/1041] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:22 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:22.663609 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-2c575fcd-1bc0-46fc-bf95-ec0544230fa6 req-4c8d7085-7e2d-4923-a63b-8cce3597f4ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de498f5-d90a-4864-a2fd-8c7634d9b07a", "name": "network-vif-deleted", "tag": "ca8d1428-556e-4ae9-b53c-d109c8daf6fe"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:25:22.668405 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:25:22.668405 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:25:22.683412 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-2c575fcd-1bc0-46fc-bf95-ec0544230fa6 req-4c8d7085-7e2d-4923-a63b-8cce3597f4ee service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:22.685382 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-2c575fcd-1bc0-46fc-bf95-ec0544230fa6 req-4c8d7085-7e2d-4923-a63b-8cce3597f4ee service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:22.711808 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-2c575fcd-1bc0-46fc-bf95-ec0544230fa6 req-4c8d7085-7e2d-4923-a63b-8cce3597f4ee service nova] Creating event network-vif-deleted:ca8d1428-556e-4ae9-b53c-d109c8daf6fe for instance 5de498f5-d90a-4864-a2fd-8c7634d9b07a on hv-cinder-77398 Feb 21 04:25:22.719568 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-2c575fcd-1bc0-46fc-bf95-ec0544230fa6 req-4c8d7085-7e2d-4923-a63b-8cce3597f4ee service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062341 Feb 21 04:25:22.723331 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 517/1042] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:25:23.545792 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c8f2556c-dc45-4124-a30b-a22330d2e90b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:23.546478 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c8f2556c-dc45-4124-a30b-a22330d2e90b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:23.546652 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-385bd75e-9e73-4aae-a843-11cef696bc34 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:23.547320 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-385bd75e-9e73-4aae-a843-11cef696bc34 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:23.558048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-385bd75e-9e73-4aae-a843-11cef696bc34 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:23.558804 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-385bd75e-9e73-4aae-a843-11cef696bc34 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:23.559754 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c8f2556c-dc45-4124-a30b-a22330d2e90b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:23.560117 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-385bd75e-9e73-4aae-a843-11cef696bc34 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:23.560243 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c8f2556c-dc45-4124-a30b-a22330d2e90b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:23.560848 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-385bd75e-9e73-4aae-a843-11cef696bc34 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:23.561018 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c8f2556c-dc45-4124-a30b-a22330d2e90b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:23.561456 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c8f2556c-dc45-4124-a30b-a22330d2e90b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:23.755742 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-c8f2556c-dc45-4124-a30b-a22330d2e90b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:23.765132 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c8f2556c-dc45-4124-a30b-a22330d2e90b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1362 microversion: 2.1 time: 0.221859 Feb 21 04:25:23.766247 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 526/1043] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:23 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:23.799422 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-385bd75e-9e73-4aae-a843-11cef696bc34 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] HTTP exception thrown: Instance 5de498f5-d90a-4864-a2fd-8c7634d9b07a could not be found. Feb 21 04:25:23.800021 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-385bd75e-9e73-4aae-a843-11cef696bc34 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Returning 404 to user: Instance 5de498f5-d90a-4864-a2fd-8c7634d9b07a could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:25:23.800884 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-385bd75e-9e73-4aae-a843-11cef696bc34 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 404 len: 111 microversion: 2.1 time: 0.258344 Feb 21 04:25:23.801440 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 518/1044] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:23 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 111 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 04:25:23.905684 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1902213383", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2040225681", "security_groups": [{"name": "tempest-secgroup-smoke-1307297902"}], "block_device_mapping_v2": [{"uuid": "6b5032e6-151d-468e-9696-649a64ed8264", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d8fa42c6-5e56-4a20-b94c-db6c502605e7"}]}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:25:24.046146 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.network.neutron [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] validate_networks() for [('d8fa42c6-5e56-4a20-b94c-db6c502605e7', None, None, None, None, None)] {{(pid=116571) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:25:24.418086 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-a8d22421-8fb2-4e47-a40e-bcbd1f72dd3b req-ad9ae7b8-3c10-4a8b-b137-c90b33970a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b3eafa-8661-45e6-a0ae-920c3499ae2f", "tag": "0b5c4c14-36fb-4fa3-a6c2-612571e2855a"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:25:24.420020 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:25:24.420020 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:25:24.440887 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-a8d22421-8fb2-4e47-a40e-bcbd1f72dd3b req-ad9ae7b8-3c10-4a8b-b137-c90b33970a1f service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:24.441346 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-a8d22421-8fb2-4e47-a40e-bcbd1f72dd3b req-ad9ae7b8-3c10-4a8b-b137-c90b33970a1f service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:24.455964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-a8d22421-8fb2-4e47-a40e-bcbd1f72dd3b req-ad9ae7b8-3c10-4a8b-b137-c90b33970a1f service nova] Creating event network-changed:0b5c4c14-36fb-4fa3-a6c2-612571e2855a for instance 93b3eafa-8661-45e6-a0ae-920c3499ae2f on hv-cinder-77398 Feb 21 04:25:24.464873 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-a8d22421-8fb2-4e47-a40e-bcbd1f72dd3b req-ad9ae7b8-3c10-4a8b-b137-c90b33970a1f service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060164 Feb 21 04:25:24.465791 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 519/1045] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:25:24.516724 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Flavor limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:25:24.517157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Image limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:25:24.517635 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Flavor pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:25:24.518080 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Image pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:25:24.518629 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:25:24.531594 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:24.532034 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:24.533354 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:24.534145 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:24.553392 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Getting quotas for project 35e5cd46d4684e9e9de6e634cfa13b5d. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:25:24.557768 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Getting quotas for user 157d93b90b374dd49ad9649be92b89a0 and project 35e5cd46d4684e9e9de6e634cfa13b5d. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:25:24.616039 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Going to run 1 instances... {{(pid=116571) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:25:24.618335 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b5032e6-151d-468e-9696-649a64ed8264',volume_size=None,volume_type=None)] {{(pid=116571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:25:24.743670 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-17cda294-a36e-4afb-94b3-f530313b001f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.842738 Feb 21 04:25:24.744340 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 527/1046] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:25:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:25:24.754891 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8ade7ad5-b899-4f46-9348-59eb995b4396 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:24.755636 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8ade7ad5-b899-4f46-9348-59eb995b4396 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:24.782819 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-bb51afe1-2b1f-4123-bc4c-cbc5b3b77af3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:24.783467 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-bb51afe1-2b1f-4123-bc4c-cbc5b3b77af3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:24.790565 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bb51afe1-2b1f-4123-bc4c-cbc5b3b77af3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:24.791220 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bb51afe1-2b1f-4123-bc4c-cbc5b3b77af3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:24.792002 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bb51afe1-2b1f-4123-bc4c-cbc5b3b77af3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:24.792432 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bb51afe1-2b1f-4123-bc4c-cbc5b3b77af3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:24.828421 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8ade7ad5-b899-4f46-9348-59eb995b4396 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:24.835409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8ade7ad5-b899-4f46-9348-59eb995b4396 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1095 microversion: 2.1 time: 0.084872 Feb 21 04:25:24.836347 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 520/1047] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:24 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1095 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:24.953465 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-bb51afe1-2b1f-4123-bc4c-cbc5b3b77af3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:24.962941 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-bb51afe1-2b1f-4123-bc4c-cbc5b3b77af3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1362 microversion: 2.1 time: 0.183648 Feb 21 04:25:24.963555 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 528/1048] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:24 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:25.852770 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fe4e7ba1-5e16-46be-8878-0f63f35fbe0d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:25.853993 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fe4e7ba1-5e16-46be-8878-0f63f35fbe0d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:25.861386 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fe4e7ba1-5e16-46be-8878-0f63f35fbe0d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:25.862121 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fe4e7ba1-5e16-46be-8878-0f63f35fbe0d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:25.863088 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fe4e7ba1-5e16-46be-8878-0f63f35fbe0d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:25.863703 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fe4e7ba1-5e16-46be-8878-0f63f35fbe0d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:25.946075 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fe4e7ba1-5e16-46be-8878-0f63f35fbe0d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:25.953249 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fe4e7ba1-5e16-46be-8878-0f63f35fbe0d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1211 microversion: 2.1 time: 0.104885 Feb 21 04:25:25.954127 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 521/1049] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:25 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:25.979814 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-486c6a3c-583d-4f49-afac-d4f6b3ee6eb0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:25.981118 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-486c6a3c-583d-4f49-afac-d4f6b3ee6eb0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:25.988131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-486c6a3c-583d-4f49-afac-d4f6b3ee6eb0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:25.988580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-486c6a3c-583d-4f49-afac-d4f6b3ee6eb0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:25.989529 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-486c6a3c-583d-4f49-afac-d4f6b3ee6eb0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:25.990081 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-486c6a3c-583d-4f49-afac-d4f6b3ee6eb0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:26.132058 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-486c6a3c-583d-4f49-afac-d4f6b3ee6eb0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:26.139990 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-486c6a3c-583d-4f49-afac-d4f6b3ee6eb0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1362 microversion: 2.1 time: 0.163947 Feb 21 04:25:26.141011 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 529/1050] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:25 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:26.971211 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5efc6805-8c09-416f-9831-798d20b1893a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:26.971826 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5efc6805-8c09-416f-9831-798d20b1893a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:26.979387 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5efc6805-8c09-416f-9831-798d20b1893a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:26.979929 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5efc6805-8c09-416f-9831-798d20b1893a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:26.980821 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5efc6805-8c09-416f-9831-798d20b1893a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:26.981518 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5efc6805-8c09-416f-9831-798d20b1893a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:27.126253 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5efc6805-8c09-416f-9831-798d20b1893a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:27.140735 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5efc6805-8c09-416f-9831-798d20b1893a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1267 microversion: 2.1 time: 0.167031 Feb 21 04:25:27.141381 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 522/1051] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:26 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:27.162833 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5165be16-646f-4653-8dc0-a280537f396d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:27.164897 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5165be16-646f-4653-8dc0-a280537f396d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:27.174814 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5165be16-646f-4653-8dc0-a280537f396d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:27.175741 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5165be16-646f-4653-8dc0-a280537f396d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:27.176807 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5165be16-646f-4653-8dc0-a280537f396d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:27.178024 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5165be16-646f-4653-8dc0-a280537f396d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:27.206846 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-27fb709e-9f70-4b2a-8403-fe78b475687e req-c045b533-8bf3-4952-87c3-7fb13eb0ad6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f0d468e-1c55-4684-8d83-192d0f7cfd9f", "tag": "dfe64259-0c81-4f8f-8deb-f058279bb2fc"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:25:27.208500 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:25:27.208500 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:25:27.236395 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-27fb709e-9f70-4b2a-8403-fe78b475687e req-c045b533-8bf3-4952-87c3-7fb13eb0ad6a service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:27.236871 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-27fb709e-9f70-4b2a-8403-fe78b475687e req-c045b533-8bf3-4952-87c3-7fb13eb0ad6a service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:27.257157 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-27fb709e-9f70-4b2a-8403-fe78b475687e req-c045b533-8bf3-4952-87c3-7fb13eb0ad6a service nova] Creating event network-changed:dfe64259-0c81-4f8f-8deb-f058279bb2fc for instance 1f0d468e-1c55-4684-8d83-192d0f7cfd9f on hv-cinder-77398 Feb 21 04:25:27.262813 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-27fb709e-9f70-4b2a-8403-fe78b475687e req-c045b533-8bf3-4952-87c3-7fb13eb0ad6a service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062129 Feb 21 04:25:27.264371 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 523/1052] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:25:27.384387 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5165be16-646f-4653-8dc0-a280537f396d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:27.392673 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5165be16-646f-4653-8dc0-a280537f396d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1362 microversion: 2.1 time: 0.236752 Feb 21 04:25:27.404006 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 530/1053] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:27 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:28.160957 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d8e9d943-3098-41c7-9e85-381dfd25d35e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:28.161663 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d8e9d943-3098-41c7-9e85-381dfd25d35e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:28.168289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d8e9d943-3098-41c7-9e85-381dfd25d35e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:28.168869 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d8e9d943-3098-41c7-9e85-381dfd25d35e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:28.169750 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d8e9d943-3098-41c7-9e85-381dfd25d35e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:28.170368 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d8e9d943-3098-41c7-9e85-381dfd25d35e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:28.306825 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d8e9d943-3098-41c7-9e85-381dfd25d35e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:28.313928 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d8e9d943-3098-41c7-9e85-381dfd25d35e tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1267 microversion: 2.1 time: 0.158953 Feb 21 04:25:28.314482 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 524/1054] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:28 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:28.409897 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b9bf4149-861e-41f0-a9dd-4a245e5921e8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:28.410541 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b9bf4149-861e-41f0-a9dd-4a245e5921e8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:28.417254 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b9bf4149-861e-41f0-a9dd-4a245e5921e8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:28.417703 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b9bf4149-861e-41f0-a9dd-4a245e5921e8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:28.418477 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b9bf4149-861e-41f0-a9dd-4a245e5921e8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:28.418911 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b9bf4149-861e-41f0-a9dd-4a245e5921e8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:28.551470 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b9bf4149-861e-41f0-a9dd-4a245e5921e8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:28.559611 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b9bf4149-861e-41f0-a9dd-4a245e5921e8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1362 microversion: 2.1 time: 0.153338 Feb 21 04:25:28.560167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 531/1055] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:28 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:29.331012 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1f2e5458-c5b2-48bb-8c4a-11e65a37b934 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:29.331768 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1f2e5458-c5b2-48bb-8c4a-11e65a37b934 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:29.338532 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1f2e5458-c5b2-48bb-8c4a-11e65a37b934 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:29.338982 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1f2e5458-c5b2-48bb-8c4a-11e65a37b934 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:29.339763 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1f2e5458-c5b2-48bb-8c4a-11e65a37b934 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:29.340209 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1f2e5458-c5b2-48bb-8c4a-11e65a37b934 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:29.361792 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-fd3a0f2c-1211-4884-8310-bbbfcc46a340 req-439f85d2-48e9-416c-912b-44f0d98f843b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b3eafa-8661-45e6-a0ae-920c3499ae2f", "name": "network-vif-plugged", "status": "completed", "tag": "0b5c4c14-36fb-4fa3-a6c2-612571e2855a"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:25:29.363359 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:25:29.363359 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:25:29.370298 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-fd3a0f2c-1211-4884-8310-bbbfcc46a340 req-439f85d2-48e9-416c-912b-44f0d98f843b service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:29.370747 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-fd3a0f2c-1211-4884-8310-bbbfcc46a340 req-439f85d2-48e9-416c-912b-44f0d98f843b service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:29.382505 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-fd3a0f2c-1211-4884-8310-bbbfcc46a340 req-439f85d2-48e9-416c-912b-44f0d98f843b service nova] Creating event network-vif-plugged:0b5c4c14-36fb-4fa3-a6c2-612571e2855a for instance 93b3eafa-8661-45e6-a0ae-920c3499ae2f on hv-cinder-77398 Feb 21 04:25:29.387553 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-fd3a0f2c-1211-4884-8310-bbbfcc46a340 req-439f85d2-48e9-416c-912b-44f0d98f843b service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093111 Feb 21 04:25:29.388485 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 525/1056] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:25:29.477003 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1f2e5458-c5b2-48bb-8c4a-11e65a37b934 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:29.484292 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1f2e5458-c5b2-48bb-8c4a-11e65a37b934 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1267 microversion: 2.1 time: 0.157213 Feb 21 04:25:29.484876 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 532/1057] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:29 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:25:29.576504 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d70b26e7-3211-446f-84bc-59ab4f3366cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:29.577237 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d70b26e7-3211-446f-84bc-59ab4f3366cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:29.583307 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d70b26e7-3211-446f-84bc-59ab4f3366cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:29.583796 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d70b26e7-3211-446f-84bc-59ab4f3366cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:29.584586 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d70b26e7-3211-446f-84bc-59ab4f3366cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:29.585317 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d70b26e7-3211-446f-84bc-59ab4f3366cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:29.715514 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d70b26e7-3211-446f-84bc-59ab4f3366cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:29.722726 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d70b26e7-3211-446f-84bc-59ab4f3366cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1362 microversion: 2.1 time: 0.150305 Feb 21 04:25:29.723290 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 526/1058] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:29 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:30.501186 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ceea41d9-13f5-4010-b075-ea12ea2dd9d2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:30.501791 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ceea41d9-13f5-4010-b075-ea12ea2dd9d2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:30.508046 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ceea41d9-13f5-4010-b075-ea12ea2dd9d2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:30.508496 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ceea41d9-13f5-4010-b075-ea12ea2dd9d2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:30.509312 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ceea41d9-13f5-4010-b075-ea12ea2dd9d2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:30.509752 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ceea41d9-13f5-4010-b075-ea12ea2dd9d2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:30.643508 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ceea41d9-13f5-4010-b075-ea12ea2dd9d2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:30.651442 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ceea41d9-13f5-4010-b075-ea12ea2dd9d2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1267 microversion: 2.1 time: 0.153930 Feb 21 04:25:30.651998 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 533/1059] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:30 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:30.738956 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-44e331d0-9789-42dd-8e4c-03fd9905f01b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:30.739624 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-44e331d0-9789-42dd-8e4c-03fd9905f01b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:30.746901 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-44e331d0-9789-42dd-8e4c-03fd9905f01b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:30.747357 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-44e331d0-9789-42dd-8e4c-03fd9905f01b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:30.748183 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-44e331d0-9789-42dd-8e4c-03fd9905f01b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:30.748617 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-44e331d0-9789-42dd-8e4c-03fd9905f01b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:30.883828 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-44e331d0-9789-42dd-8e4c-03fd9905f01b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:30.892445 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-44e331d0-9789-42dd-8e4c-03fd9905f01b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1362 microversion: 2.1 time: 0.156957 Feb 21 04:25:30.893106 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 527/1060] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:30 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:31.668157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d7c95fff-e62b-445e-bf9d-52e97493c5f5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:31.668821 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d7c95fff-e62b-445e-bf9d-52e97493c5f5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:31.675028 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d7c95fff-e62b-445e-bf9d-52e97493c5f5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:31.675471 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d7c95fff-e62b-445e-bf9d-52e97493c5f5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:31.676236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d7c95fff-e62b-445e-bf9d-52e97493c5f5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:31.676696 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d7c95fff-e62b-445e-bf9d-52e97493c5f5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:31.812072 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d7c95fff-e62b-445e-bf9d-52e97493c5f5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:31.819224 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d7c95fff-e62b-445e-bf9d-52e97493c5f5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1267 microversion: 2.1 time: 0.154688 Feb 21 04:25:31.819782 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 534/1061] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:31 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:31.909484 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3f8a96df-fbf0-4bd8-9b77-eab1e7a46d1c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:31.910097 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3f8a96df-fbf0-4bd8-9b77-eab1e7a46d1c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:31.917177 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3f8a96df-fbf0-4bd8-9b77-eab1e7a46d1c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:31.917629 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3f8a96df-fbf0-4bd8-9b77-eab1e7a46d1c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:31.918464 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3f8a96df-fbf0-4bd8-9b77-eab1e7a46d1c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:31.918850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3f8a96df-fbf0-4bd8-9b77-eab1e7a46d1c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:32.047100 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3f8a96df-fbf0-4bd8-9b77-eab1e7a46d1c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:32.054254 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3f8a96df-fbf0-4bd8-9b77-eab1e7a46d1c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1547 microversion: 2.1 time: 0.148368 Feb 21 04:25:32.054984 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 528/1062] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:31 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:32.070047 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-37b65c8d-7ec7-4cfa-95f6-ec951403c09b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:32.070540 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-37b65c8d-7ec7-4cfa-95f6-ec951403c09b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:32.076281 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-37b65c8d-7ec7-4cfa-95f6-ec951403c09b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:32.076766 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-37b65c8d-7ec7-4cfa-95f6-ec951403c09b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:32.077544 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-37b65c8d-7ec7-4cfa-95f6-ec951403c09b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:32.077980 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-37b65c8d-7ec7-4cfa-95f6-ec951403c09b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:32.157259 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-37b65c8d-7ec7-4cfa-95f6-ec951403c09b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090841 Feb 21 04:25:32.157851 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 535/1063] 10.222.0.10 () {58 vars in 1274 bytes} [Mon Feb 21 04:25:32 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:25:32.835382 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-980475ad-62f5-467b-9e77-a93eddc7ae3f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:32.835944 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-980475ad-62f5-467b-9e77-a93eddc7ae3f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:32.841702 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-980475ad-62f5-467b-9e77-a93eddc7ae3f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:32.842154 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-980475ad-62f5-467b-9e77-a93eddc7ae3f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:32.842931 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-980475ad-62f5-467b-9e77-a93eddc7ae3f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:32.843365 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-980475ad-62f5-467b-9e77-a93eddc7ae3f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:33.100570 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-980475ad-62f5-467b-9e77-a93eddc7ae3f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:33.107948 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-980475ad-62f5-467b-9e77-a93eddc7ae3f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1267 microversion: 2.1 time: 0.276449 Feb 21 04:25:33.118200 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 529/1064] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:32 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:33.420788 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-2a979388-2266-433d-aef3-429cd6a9c509 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:33.426050 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-c9ce18a3-d646-4c70-bb2c-a6252ba47419 req-80a6fa0a-2656-4d47-b762-fbd9a306451f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b3eafa-8661-45e6-a0ae-920c3499ae2f", "tag": "0b5c4c14-36fb-4fa3-a6c2-612571e2855a"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:25:33.427667 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:25:33.427667 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:25:33.427926 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-2a979388-2266-433d-aef3-429cd6a9c509 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:33.435351 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2a979388-2266-433d-aef3-429cd6a9c509 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:33.435804 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2a979388-2266-433d-aef3-429cd6a9c509 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:33.436883 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2a979388-2266-433d-aef3-429cd6a9c509 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:33.437327 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2a979388-2266-433d-aef3-429cd6a9c509 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:33.437881 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-c9ce18a3-d646-4c70-bb2c-a6252ba47419 req-80a6fa0a-2656-4d47-b762-fbd9a306451f service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:33.438329 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-c9ce18a3-d646-4c70-bb2c-a6252ba47419 req-80a6fa0a-2656-4d47-b762-fbd9a306451f service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:33.449602 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-c9ce18a3-d646-4c70-bb2c-a6252ba47419 req-80a6fa0a-2656-4d47-b762-fbd9a306451f service nova] Creating event network-changed:0b5c4c14-36fb-4fa3-a6c2-612571e2855a for instance 93b3eafa-8661-45e6-a0ae-920c3499ae2f on hv-cinder-77398 Feb 21 04:25:33.456112 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-c9ce18a3-d646-4c70-bb2c-a6252ba47419 req-80a6fa0a-2656-4d47-b762-fbd9a306451f service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033606 Feb 21 04:25:33.457204 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 530/1065] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:25:33.462612 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-2a979388-2266-433d-aef3-429cd6a9c509 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/ips" status: 200 len: 105 microversion: 2.1 time: 0.045569 Feb 21 04:25:33.467881 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 536/1066] 10.222.0.10 () {58 vars in 1247 bytes} [Mon Feb 21 04:25:33 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/ips => generated 105 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:25:34.126175 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-aa4eef9b-96e9-4cc3-88f6-e292ef8408a8 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:34.126872 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-aa4eef9b-96e9-4cc3-88f6-e292ef8408a8 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:34.133455 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aa4eef9b-96e9-4cc3-88f6-e292ef8408a8 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:34.133904 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aa4eef9b-96e9-4cc3-88f6-e292ef8408a8 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:34.134683 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aa4eef9b-96e9-4cc3-88f6-e292ef8408a8 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:34.135118 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aa4eef9b-96e9-4cc3-88f6-e292ef8408a8 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:34.272888 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-aa4eef9b-96e9-4cc3-88f6-e292ef8408a8 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:34.280588 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-aa4eef9b-96e9-4cc3-88f6-e292ef8408a8 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1267 microversion: 2.1 time: 0.158816 Feb 21 04:25:34.281197 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 531/1067] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:34 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:35.297195 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-82ce638c-eb6b-4b63-be16-7cd2722985a1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:35.297812 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-82ce638c-eb6b-4b63-be16-7cd2722985a1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:35.304105 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-82ce638c-eb6b-4b63-be16-7cd2722985a1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:35.304562 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-82ce638c-eb6b-4b63-be16-7cd2722985a1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:35.305376 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-82ce638c-eb6b-4b63-be16-7cd2722985a1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:35.305813 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-82ce638c-eb6b-4b63-be16-7cd2722985a1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:35.446751 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-82ce638c-eb6b-4b63-be16-7cd2722985a1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:35.453992 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-82ce638c-eb6b-4b63-be16-7cd2722985a1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1267 microversion: 2.1 time: 0.160475 Feb 21 04:25:35.454543 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 537/1068] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:35 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:36.471071 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b3752162-151a-4e54-864f-7340eca674ad tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:36.472148 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b3752162-151a-4e54-864f-7340eca674ad tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:36.478548 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b3752162-151a-4e54-864f-7340eca674ad tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:36.479000 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b3752162-151a-4e54-864f-7340eca674ad tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:36.479793 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b3752162-151a-4e54-864f-7340eca674ad tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:36.480229 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b3752162-151a-4e54-864f-7340eca674ad tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:36.610918 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b3752162-151a-4e54-864f-7340eca674ad tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:36.618041 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b3752162-151a-4e54-864f-7340eca674ad tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1267 microversion: 2.1 time: 0.150650 Feb 21 04:25:36.618598 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 532/1069] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:36 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:37.302750 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-667a4a63-d673-4013-bc65-1113e980820c req-7191241e-1486-4baa-8ee6-d42a04139452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f0d468e-1c55-4684-8d83-192d0f7cfd9f", "name": "network-vif-plugged", "status": "completed", "tag": "dfe64259-0c81-4f8f-8deb-f058279bb2fc"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:25:37.304370 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:25:37.304370 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:25:37.311583 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-667a4a63-d673-4013-bc65-1113e980820c req-7191241e-1486-4baa-8ee6-d42a04139452 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:37.311952 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-667a4a63-d673-4013-bc65-1113e980820c req-7191241e-1486-4baa-8ee6-d42a04139452 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:37.323505 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-667a4a63-d673-4013-bc65-1113e980820c req-7191241e-1486-4baa-8ee6-d42a04139452 service nova] Creating event network-vif-plugged:dfe64259-0c81-4f8f-8deb-f058279bb2fc for instance 1f0d468e-1c55-4684-8d83-192d0f7cfd9f on hv-cinder-77398 Feb 21 04:25:37.328378 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-667a4a63-d673-4013-bc65-1113e980820c req-7191241e-1486-4baa-8ee6-d42a04139452 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030238 Feb 21 04:25:37.329017 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 538/1070] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:25:37.634572 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-347182b9-8c63-41e0-a960-75d82cb43dbc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:37.635185 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-347182b9-8c63-41e0-a960-75d82cb43dbc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:37.641383 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-347182b9-8c63-41e0-a960-75d82cb43dbc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:37.641832 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-347182b9-8c63-41e0-a960-75d82cb43dbc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:37.642607 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-347182b9-8c63-41e0-a960-75d82cb43dbc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:37.643041 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-347182b9-8c63-41e0-a960-75d82cb43dbc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:37.776814 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-347182b9-8c63-41e0-a960-75d82cb43dbc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:37.784294 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-347182b9-8c63-41e0-a960-75d82cb43dbc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1267 microversion: 2.1 time: 0.153413 Feb 21 04:25:37.784895 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 533/1071] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:37 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:38.802385 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4650373b-d0c9-48b3-a215-f2ec861d863f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:38.803589 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4650373b-d0c9-48b3-a215-f2ec861d863f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:38.809523 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4650373b-d0c9-48b3-a215-f2ec861d863f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:38.809970 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4650373b-d0c9-48b3-a215-f2ec861d863f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:38.810732 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4650373b-d0c9-48b3-a215-f2ec861d863f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:38.811160 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4650373b-d0c9-48b3-a215-f2ec861d863f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:38.948519 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4650373b-d0c9-48b3-a215-f2ec861d863f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:38.955962 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4650373b-d0c9-48b3-a215-f2ec861d863f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1267 microversion: 2.1 time: 0.158071 Feb 21 04:25:38.956854 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 539/1072] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:38 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:39.973445 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5389a50d-114f-484a-944e-a85ab4e108c2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:39.974090 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5389a50d-114f-484a-944e-a85ab4e108c2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:39.980328 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5389a50d-114f-484a-944e-a85ab4e108c2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:39.980822 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5389a50d-114f-484a-944e-a85ab4e108c2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:39.981604 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5389a50d-114f-484a-944e-a85ab4e108c2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:39.982040 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5389a50d-114f-484a-944e-a85ab4e108c2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:40.117042 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5389a50d-114f-484a-944e-a85ab4e108c2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:40.124280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5389a50d-114f-484a-944e-a85ab4e108c2 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1455 microversion: 2.1 time: 0.154454 Feb 21 04:25:40.124888 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 534/1073] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:39 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:40.140624 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-05640517-290a-4806-b89d-cda629883c82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:25:40.141263 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-05640517-290a-4806-b89d-cda629883c82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:25:40.147491 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-05640517-290a-4806-b89d-cda629883c82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:40.147942 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-05640517-290a-4806-b89d-cda629883c82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:40.148757 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-05640517-290a-4806-b89d-cda629883c82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:40.149200 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-05640517-290a-4806-b89d-cda629883c82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:40.284147 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-05640517-290a-4806-b89d-cda629883c82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:25:40.291402 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-05640517-290a-4806-b89d-cda629883c82 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1455 microversion: 2.1 time: 0.154382 Feb 21 04:25:40.291967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 540/1074] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:25:40 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:25:42.119912 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-86904b14-b4e0-4e16-a900-3f80ae1afceb req-f92f0b76-7bd0-4ca2-b40d-209ad76e4e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f0d468e-1c55-4684-8d83-192d0f7cfd9f", "tag": "dfe64259-0c81-4f8f-8deb-f058279bb2fc"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:25:42.121442 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:25:42.121442 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:25:42.128914 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-86904b14-b4e0-4e16-a900-3f80ae1afceb req-f92f0b76-7bd0-4ca2-b40d-209ad76e4e20 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:25:42.129359 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-86904b14-b4e0-4e16-a900-3f80ae1afceb req-f92f0b76-7bd0-4ca2-b40d-209ad76e4e20 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:25:42.140660 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-86904b14-b4e0-4e16-a900-3f80ae1afceb req-f92f0b76-7bd0-4ca2-b40d-209ad76e4e20 service nova] Creating event network-changed:dfe64259-0c81-4f8f-8deb-f058279bb2fc for instance 1f0d468e-1c55-4684-8d83-192d0f7cfd9f on hv-cinder-77398 Feb 21 04:25:42.145650 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-86904b14-b4e0-4e16-a900-3f80ae1afceb req-f92f0b76-7bd0-4ca2-b40d-209ad76e4e20 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029267 Feb 21 04:25:42.146236 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 535/1075] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:26:50.650733 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-c297d39e-91d4-43e9-933b-afbd510e08c0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b98d95b-1902-45ea-ba5a-c348c5b038bc"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:26:50.651774 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-c297d39e-91d4-43e9-933b-afbd510e08c0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:26:50.657793 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c297d39e-91d4-43e9-933b-afbd510e08c0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:26:50.658237 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c297d39e-91d4-43e9-933b-afbd510e08c0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:26:50.659000 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c297d39e-91d4-43e9-933b-afbd510e08c0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:26:50.659428 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-c297d39e-91d4-43e9-933b-afbd510e08c0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:26:50.880518 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-c297d39e-91d4-43e9-933b-afbd510e08c0 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "POST /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.234333 Feb 21 04:26:50.881183 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 541/1076] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:26:50 2022] POST /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/os-volume_attachments => generated 194 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:26:57.467865 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-84e776f5-5833-468b-a21e-6cdd89360bc1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:26:57.474492 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-84e776f5-5833-468b-a21e-6cdd89360bc1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:26:57.474938 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-84e776f5-5833-468b-a21e-6cdd89360bc1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:26:57.533246 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-84e776f5-5833-468b-a21e-6cdd89360bc1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Going to try to stop instance {{(pid=116570) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 21 04:26:57.574402 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-84e776f5-5833-468b-a21e-6cdd89360bc1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "POST /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/action" status: 202 len: 0 microversion: 2.1 time: 0.111660 Feb 21 04:26:57.574910 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 536/1077] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:26:57 2022] POST /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:26:57.584826 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-674d4d0f-2701-4d5e-b53d-edebfa23fd59 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:26:57.585527 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-674d4d0f-2701-4d5e-b53d-edebfa23fd59 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:26:57.591621 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-674d4d0f-2701-4d5e-b53d-edebfa23fd59 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:26:57.592023 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-674d4d0f-2701-4d5e-b53d-edebfa23fd59 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:26:57.593063 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-674d4d0f-2701-4d5e-b53d-edebfa23fd59 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:26:57.593502 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-674d4d0f-2701-4d5e-b53d-edebfa23fd59 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:26:57.728329 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-674d4d0f-2701-4d5e-b53d-edebfa23fd59 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:26:57.735963 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-674d4d0f-2701-4d5e-b53d-edebfa23fd59 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.156718 Feb 21 04:26:57.736513 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 542/1078] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:26:57 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:26:58.754136 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e6854cde-f853-40b0-8523-48f1c3fc9006 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:26:58.754827 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e6854cde-f853-40b0-8523-48f1c3fc9006 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:26:58.760866 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6854cde-f853-40b0-8523-48f1c3fc9006 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:26:58.761315 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6854cde-f853-40b0-8523-48f1c3fc9006 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:26:58.762086 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6854cde-f853-40b0-8523-48f1c3fc9006 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:26:58.762517 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6854cde-f853-40b0-8523-48f1c3fc9006 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:26:58.893721 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e6854cde-f853-40b0-8523-48f1c3fc9006 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:26:58.901873 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e6854cde-f853-40b0-8523-48f1c3fc9006 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.152301 Feb 21 04:26:58.902437 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 537/1079] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:26:58 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:26:59.920064 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-ef0f1c97-f886-4d2e-9aa1-0be74aa78420 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:26:59.920700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-ef0f1c97-f886-4d2e-9aa1-0be74aa78420 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:26:59.927524 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ef0f1c97-f886-4d2e-9aa1-0be74aa78420 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:26:59.927976 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ef0f1c97-f886-4d2e-9aa1-0be74aa78420 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:26:59.928780 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ef0f1c97-f886-4d2e-9aa1-0be74aa78420 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:26:59.929217 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-ef0f1c97-f886-4d2e-9aa1-0be74aa78420 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:00.057455 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-ef0f1c97-f886-4d2e-9aa1-0be74aa78420 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:00.065106 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-ef0f1c97-f886-4d2e-9aa1-0be74aa78420 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.149263 Feb 21 04:27:00.065670 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 543/1080] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:26:59 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:01.082045 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-db374425-2fc2-44ed-8e2f-faf1ff904cc8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:01.082709 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-db374425-2fc2-44ed-8e2f-faf1ff904cc8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:01.088839 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-db374425-2fc2-44ed-8e2f-faf1ff904cc8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:01.089294 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-db374425-2fc2-44ed-8e2f-faf1ff904cc8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:01.090106 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-db374425-2fc2-44ed-8e2f-faf1ff904cc8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:01.090545 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-db374425-2fc2-44ed-8e2f-faf1ff904cc8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:01.221639 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-db374425-2fc2-44ed-8e2f-faf1ff904cc8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:01.229289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-db374425-2fc2-44ed-8e2f-faf1ff904cc8 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.151004 Feb 21 04:27:01.229853 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 538/1081] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:01 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:02.245918 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-51f63ec8-2161-463f-a636-250140f2cdfe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:02.246559 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-51f63ec8-2161-463f-a636-250140f2cdfe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:02.253156 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-51f63ec8-2161-463f-a636-250140f2cdfe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:02.253638 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-51f63ec8-2161-463f-a636-250140f2cdfe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:02.254438 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-51f63ec8-2161-463f-a636-250140f2cdfe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:02.254875 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-51f63ec8-2161-463f-a636-250140f2cdfe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:02.387555 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-51f63ec8-2161-463f-a636-250140f2cdfe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:02.395174 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-51f63ec8-2161-463f-a636-250140f2cdfe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.152960 Feb 21 04:27:02.395727 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 544/1082] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:02 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:27:03.412212 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2e6e5188-3ab7-4154-89c1-fbb11ffa648d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:03.412839 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2e6e5188-3ab7-4154-89c1-fbb11ffa648d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:03.419034 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e6e5188-3ab7-4154-89c1-fbb11ffa648d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:03.419483 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e6e5188-3ab7-4154-89c1-fbb11ffa648d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:03.420256 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e6e5188-3ab7-4154-89c1-fbb11ffa648d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:03.420715 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e6e5188-3ab7-4154-89c1-fbb11ffa648d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:03.550384 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2e6e5188-3ab7-4154-89c1-fbb11ffa648d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:03.558475 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2e6e5188-3ab7-4154-89c1-fbb11ffa648d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.149985 Feb 21 04:27:03.559026 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 539/1083] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:03 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:04.575729 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4afdfc46-c491-479f-86f0-6b43d2c0e23b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:04.576334 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4afdfc46-c491-479f-86f0-6b43d2c0e23b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:04.583138 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4afdfc46-c491-479f-86f0-6b43d2c0e23b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:04.583583 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4afdfc46-c491-479f-86f0-6b43d2c0e23b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:04.584362 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4afdfc46-c491-479f-86f0-6b43d2c0e23b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:04.584802 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4afdfc46-c491-479f-86f0-6b43d2c0e23b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:04.717911 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4afdfc46-c491-479f-86f0-6b43d2c0e23b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:04.725490 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4afdfc46-c491-479f-86f0-6b43d2c0e23b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.153467 Feb 21 04:27:04.726045 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 545/1084] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:04 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:05.742616 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fd89c845-39bf-47ed-aa30-16ccbdc1f6a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:05.743262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fd89c845-39bf-47ed-aa30-16ccbdc1f6a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:05.749523 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fd89c845-39bf-47ed-aa30-16ccbdc1f6a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:05.749977 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fd89c845-39bf-47ed-aa30-16ccbdc1f6a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:05.750757 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fd89c845-39bf-47ed-aa30-16ccbdc1f6a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:05.751195 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fd89c845-39bf-47ed-aa30-16ccbdc1f6a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:05.879974 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fd89c845-39bf-47ed-aa30-16ccbdc1f6a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:05.887621 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fd89c845-39bf-47ed-aa30-16ccbdc1f6a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.149147 Feb 21 04:27:05.888188 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 540/1085] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:05 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:06.904497 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d183eb87-e674-4517-bb55-6a84542f8ea3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:06.905208 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d183eb87-e674-4517-bb55-6a84542f8ea3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:06.911528 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d183eb87-e674-4517-bb55-6a84542f8ea3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:06.911976 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d183eb87-e674-4517-bb55-6a84542f8ea3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:06.912788 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d183eb87-e674-4517-bb55-6a84542f8ea3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:06.913228 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d183eb87-e674-4517-bb55-6a84542f8ea3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:07.048103 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d183eb87-e674-4517-bb55-6a84542f8ea3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:07.056280 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d183eb87-e674-4517-bb55-6a84542f8ea3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.155686 Feb 21 04:27:07.056868 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 546/1086] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:06 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:08.072505 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3d225d89-ba66-40af-8b34-fd92b4eb9688 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:08.073078 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3d225d89-ba66-40af-8b34-fd92b4eb9688 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:08.079239 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3d225d89-ba66-40af-8b34-fd92b4eb9688 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:08.079690 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3d225d89-ba66-40af-8b34-fd92b4eb9688 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:08.080459 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3d225d89-ba66-40af-8b34-fd92b4eb9688 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:08.080918 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3d225d89-ba66-40af-8b34-fd92b4eb9688 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:08.210885 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3d225d89-ba66-40af-8b34-fd92b4eb9688 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:08.218759 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3d225d89-ba66-40af-8b34-fd92b4eb9688 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.149822 Feb 21 04:27:08.219386 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 541/1087] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:08 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:09.235795 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-33da7cde-b998-4ffd-8402-2f8e472041cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:09.236431 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-33da7cde-b998-4ffd-8402-2f8e472041cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:09.242615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-33da7cde-b998-4ffd-8402-2f8e472041cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:09.243059 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-33da7cde-b998-4ffd-8402-2f8e472041cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:09.243825 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-33da7cde-b998-4ffd-8402-2f8e472041cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:09.244258 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-33da7cde-b998-4ffd-8402-2f8e472041cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:09.375864 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-33da7cde-b998-4ffd-8402-2f8e472041cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:09.383659 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-33da7cde-b998-4ffd-8402-2f8e472041cf tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.151606 Feb 21 04:27:09.384217 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 547/1088] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:09 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:10.399223 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-cea06923-1aa7-4783-b676-facb4443b485 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:10.399830 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-cea06923-1aa7-4783-b676-facb4443b485 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:10.406290 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cea06923-1aa7-4783-b676-facb4443b485 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:10.406733 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cea06923-1aa7-4783-b676-facb4443b485 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:10.407500 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cea06923-1aa7-4783-b676-facb4443b485 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:10.407926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cea06923-1aa7-4783-b676-facb4443b485 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:10.540914 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-cea06923-1aa7-4783-b676-facb4443b485 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:10.548520 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-cea06923-1aa7-4783-b676-facb4443b485 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.152943 Feb 21 04:27:10.549114 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 542/1089] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:10 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:11.565450 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b70eba03-57e8-44bf-be26-90ccfd2be38d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:11.565970 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b70eba03-57e8-44bf-be26-90ccfd2be38d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:11.572146 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b70eba03-57e8-44bf-be26-90ccfd2be38d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:11.572591 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b70eba03-57e8-44bf-be26-90ccfd2be38d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:11.573382 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b70eba03-57e8-44bf-be26-90ccfd2be38d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:11.573813 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b70eba03-57e8-44bf-be26-90ccfd2be38d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:11.709122 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b70eba03-57e8-44bf-be26-90ccfd2be38d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:11.716911 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b70eba03-57e8-44bf-be26-90ccfd2be38d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.155157 Feb 21 04:27:11.717475 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 548/1090] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:11 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:12.733925 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4c171b3a-e77c-4c9e-872d-4d097fcf1e2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:12.734540 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4c171b3a-e77c-4c9e-872d-4d097fcf1e2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:12.741666 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4c171b3a-e77c-4c9e-872d-4d097fcf1e2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:12.742117 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4c171b3a-e77c-4c9e-872d-4d097fcf1e2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:12.742893 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4c171b3a-e77c-4c9e-872d-4d097fcf1e2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:12.743322 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4c171b3a-e77c-4c9e-872d-4d097fcf1e2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:12.874328 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-4c171b3a-e77c-4c9e-872d-4d097fcf1e2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:12.881999 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4c171b3a-e77c-4c9e-872d-4d097fcf1e2a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.151775 Feb 21 04:27:12.882560 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 543/1091] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:12 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:13.898774 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0e48eab1-810e-4bd0-b1d3-597c7be0199d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:13.899381 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0e48eab1-810e-4bd0-b1d3-597c7be0199d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:13.905828 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0e48eab1-810e-4bd0-b1d3-597c7be0199d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:13.906273 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0e48eab1-810e-4bd0-b1d3-597c7be0199d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:13.907039 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0e48eab1-810e-4bd0-b1d3-597c7be0199d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:13.907504 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0e48eab1-810e-4bd0-b1d3-597c7be0199d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:14.045517 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-0e48eab1-810e-4bd0-b1d3-597c7be0199d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:14.053700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0e48eab1-810e-4bd0-b1d3-597c7be0199d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.158651 Feb 21 04:27:14.054265 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 549/1092] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:13 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:15.070835 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-87104b3f-fbb5-4dce-ac48-e9c7d66da2b1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:15.071364 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-87104b3f-fbb5-4dce-ac48-e9c7d66da2b1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:15.077606 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-87104b3f-fbb5-4dce-ac48-e9c7d66da2b1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:15.078058 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-87104b3f-fbb5-4dce-ac48-e9c7d66da2b1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:15.078833 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-87104b3f-fbb5-4dce-ac48-e9c7d66da2b1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:15.079273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-87104b3f-fbb5-4dce-ac48-e9c7d66da2b1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:15.211153 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-87104b3f-fbb5-4dce-ac48-e9c7d66da2b1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:15.218832 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-87104b3f-fbb5-4dce-ac48-e9c7d66da2b1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.152244 Feb 21 04:27:15.219397 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 544/1093] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:15 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:16.235564 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-784b1157-162e-4cc0-b164-88880f4b88c7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:16.236182 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-784b1157-162e-4cc0-b164-88880f4b88c7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:16.242412 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-784b1157-162e-4cc0-b164-88880f4b88c7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:16.242860 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-784b1157-162e-4cc0-b164-88880f4b88c7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:16.243632 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-784b1157-162e-4cc0-b164-88880f4b88c7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:16.244077 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-784b1157-162e-4cc0-b164-88880f4b88c7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:16.374768 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-784b1157-162e-4cc0-b164-88880f4b88c7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:16.383136 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-784b1157-162e-4cc0-b164-88880f4b88c7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.151193 Feb 21 04:27:16.383976 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 550/1094] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:16 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:17.399304 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2e2519cb-cc50-4cdd-ba71-2ce664066707 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:17.399897 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2e2519cb-cc50-4cdd-ba71-2ce664066707 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:17.406360 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e2519cb-cc50-4cdd-ba71-2ce664066707 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:17.406803 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e2519cb-cc50-4cdd-ba71-2ce664066707 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:17.407569 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e2519cb-cc50-4cdd-ba71-2ce664066707 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:17.407998 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2e2519cb-cc50-4cdd-ba71-2ce664066707 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:17.536580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2e2519cb-cc50-4cdd-ba71-2ce664066707 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:17.545055 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2e2519cb-cc50-4cdd-ba71-2ce664066707 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1721 microversion: 2.1 time: 0.149179 Feb 21 04:27:17.545631 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 545/1095] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:17 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:18.562716 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5c713b85-1276-40f6-9e95-097e92d7fd1a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:18.563282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5c713b85-1276-40f6-9e95-097e92d7fd1a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:18.570392 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5c713b85-1276-40f6-9e95-097e92d7fd1a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:18.570979 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5c713b85-1276-40f6-9e95-097e92d7fd1a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:18.571776 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5c713b85-1276-40f6-9e95-097e92d7fd1a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:18.572207 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5c713b85-1276-40f6-9e95-097e92d7fd1a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:18.706958 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5c713b85-1276-40f6-9e95-097e92d7fd1a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:18.714754 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5c713b85-1276-40f6-9e95-097e92d7fd1a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1698 microversion: 2.1 time: 0.156387 Feb 21 04:27:18.715304 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 551/1096] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:18 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:18.731008 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-06720cd5-b2bd-4c21-8d9e-26454797fa8b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:27:18.737409 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-06720cd5-b2bd-4c21-8d9e-26454797fa8b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:18.737930 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-06720cd5-b2bd-4c21-8d9e-26454797fa8b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:18.761380 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-06720cd5-b2bd-4c21-8d9e-26454797fa8b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Going to try to start instance {{(pid=116570) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 21 04:27:18.801733 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-06720cd5-b2bd-4c21-8d9e-26454797fa8b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "POST /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/action" status: 202 len: 0 microversion: 2.1 time: 0.073622 Feb 21 04:27:18.802316 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 546/1097] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:27:18 2022] POST /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 04:27:18.809985 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f0621a8b-fedf-4261-a0ba-9bed03c8be96 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:18.810587 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f0621a8b-fedf-4261-a0ba-9bed03c8be96 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:18.816467 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f0621a8b-fedf-4261-a0ba-9bed03c8be96 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:18.816942 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f0621a8b-fedf-4261-a0ba-9bed03c8be96 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:18.817735 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f0621a8b-fedf-4261-a0ba-9bed03c8be96 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:18.818269 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f0621a8b-fedf-4261-a0ba-9bed03c8be96 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:18.949658 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-f0621a8b-fedf-4261-a0ba-9bed03c8be96 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:18.957850 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f0621a8b-fedf-4261-a0ba-9bed03c8be96 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1707 microversion: 2.1 time: 0.151405 Feb 21 04:27:18.958417 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 552/1098] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:18 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1707 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:19.975853 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e844ebe6-f421-4243-9780-9167827c531d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:19.976593 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e844ebe6-f421-4243-9780-9167827c531d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:19.982580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e844ebe6-f421-4243-9780-9167827c531d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:19.983030 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e844ebe6-f421-4243-9780-9167827c531d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:19.983810 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e844ebe6-f421-4243-9780-9167827c531d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:19.984245 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e844ebe6-f421-4243-9780-9167827c531d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:20.122430 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e844ebe6-f421-4243-9780-9167827c531d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:20.130121 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e844ebe6-f421-4243-9780-9167827c531d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1707 microversion: 2.1 time: 0.158799 Feb 21 04:27:20.130693 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 547/1099] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:19 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1707 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:21.147526 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-bf8b1bff-325a-4316-b274-f99974cd7a4b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:21.148123 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-bf8b1bff-325a-4316-b274-f99974cd7a4b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:21.154741 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bf8b1bff-325a-4316-b274-f99974cd7a4b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:21.155191 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bf8b1bff-325a-4316-b274-f99974cd7a4b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:21.155964 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bf8b1bff-325a-4316-b274-f99974cd7a4b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:21.156397 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bf8b1bff-325a-4316-b274-f99974cd7a4b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:21.285346 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-bf8b1bff-325a-4316-b274-f99974cd7a4b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:21.293073 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-bf8b1bff-325a-4316-b274-f99974cd7a4b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1711 microversion: 2.1 time: 0.149756 Feb 21 04:27:21.293642 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 553/1100] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:21 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1711 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:53.269463 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-95328939", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2040225681", "security_groups": [{"name": "tempest-secgroup-smoke-1307297902"}], "block_device_mapping_v2": [{"uuid": "823d22af-5eea-44c5-8978-a778f1900fe0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d8fa42c6-5e56-4a20-b94c-db6c502605e7"}]}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:27:53.374262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.network.neutron [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] validate_networks() for [('d8fa42c6-5e56-4a20-b94c-db6c502605e7', None, None, None, None, None)] {{(pid=116570) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:27:53.726881 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Flavor limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:27:53.727245 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Image limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:27:53.727719 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Flavor pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:27:53.728144 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Image pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:27:53.728548 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:27:53.736858 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:53.737301 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:53.738137 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:53.742121 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:53.754810 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Getting quotas for project 35e5cd46d4684e9e9de6e634cfa13b5d. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:27:53.759413 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Getting quotas for user 157d93b90b374dd49ad9649be92b89a0 and project 35e5cd46d4684e9e9de6e634cfa13b5d. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:27:53.812898 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Going to run 1 instances... {{(pid=116570) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:27:53.814998 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='823d22af-5eea-44c5-8978-a778f1900fe0',volume_size=None,volume_type=None)] {{(pid=116570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:27:53.931368 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6cad795a-ec90-47c3-9470-dd4bbeeed57d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.665627 Feb 21 04:27:53.932003 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 548/1101] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:27:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:27:53.942202 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e2c754b9-8aa1-4783-924b-8431c19c49cc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:53.942831 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e2c754b9-8aa1-4783-924b-8431c19c49cc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:53.997789 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e2c754b9-8aa1-4783-924b-8431c19c49cc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:54.006580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e2c754b9-8aa1-4783-924b-8431c19c49cc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1093 microversion: 2.1 time: 0.068530 Feb 21 04:27:54.007160 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 554/1102] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:53 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:55.023684 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e1fa3e45-34d3-442a-96a2-1c52abcbbdfc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:55.024202 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e1fa3e45-34d3-442a-96a2-1c52abcbbdfc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:55.031580 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e1fa3e45-34d3-442a-96a2-1c52abcbbdfc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:55.032031 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e1fa3e45-34d3-442a-96a2-1c52abcbbdfc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:55.032844 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e1fa3e45-34d3-442a-96a2-1c52abcbbdfc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:55.033309 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e1fa3e45-34d3-442a-96a2-1c52abcbbdfc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:55.095064 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e1fa3e45-34d3-442a-96a2-1c52abcbbdfc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:55.102956 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e1fa3e45-34d3-442a-96a2-1c52abcbbdfc tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1209 microversion: 2.1 time: 0.083498 Feb 21 04:27:55.103519 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 549/1103] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:55 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:56.121322 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3da13ea7-b3ec-4d99-a7ea-f136ca120ba7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:56.122102 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3da13ea7-b3ec-4d99-a7ea-f136ca120ba7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:56.151237 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3da13ea7-b3ec-4d99-a7ea-f136ca120ba7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:56.151944 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3da13ea7-b3ec-4d99-a7ea-f136ca120ba7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:56.153329 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3da13ea7-b3ec-4d99-a7ea-f136ca120ba7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:56.153768 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3da13ea7-b3ec-4d99-a7ea-f136ca120ba7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:56.198511 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-d9fbe485-b3b7-4a46-92f2-b77b6801f9de req-76cb3375-8144-444f-bc8f-a7ee0c25e7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183ac1ab-bbc7-45b8-854d-c2a58fa0efdb", "tag": "35b91d10-b47f-430e-984b-065790ea3b32"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:27:56.200298 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:27:56.200298 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:27:56.208987 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-d9fbe485-b3b7-4a46-92f2-b77b6801f9de req-76cb3375-8144-444f-bc8f-a7ee0c25e7f5 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:56.209634 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-d9fbe485-b3b7-4a46-92f2-b77b6801f9de req-76cb3375-8144-444f-bc8f-a7ee0c25e7f5 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:56.220918 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-d9fbe485-b3b7-4a46-92f2-b77b6801f9de req-76cb3375-8144-444f-bc8f-a7ee0c25e7f5 service nova] Creating event network-changed:35b91d10-b47f-430e-984b-065790ea3b32 for instance 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb on hv-cinder-77398 Feb 21 04:27:56.229582 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-d9fbe485-b3b7-4a46-92f2-b77b6801f9de req-76cb3375-8144-444f-bc8f-a7ee0c25e7f5 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119209 Feb 21 04:27:56.230186 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 555/1104] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:27:56.320974 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-3da13ea7-b3ec-4d99-a7ea-f136ca120ba7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:56.328361 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3da13ea7-b3ec-4d99-a7ea-f136ca120ba7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1265 microversion: 2.1 time: 0.212046 Feb 21 04:27:56.329282 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 550/1105] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:56 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:57.346967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3d3c0a88-03c6-42d1-976f-000b3eb3ebfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:57.347600 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-3d3c0a88-03c6-42d1-976f-000b3eb3ebfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:57.353620 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3d3c0a88-03c6-42d1-976f-000b3eb3ebfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:57.354063 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3d3c0a88-03c6-42d1-976f-000b3eb3ebfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:57.354828 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3d3c0a88-03c6-42d1-976f-000b3eb3ebfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:57.355257 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-3d3c0a88-03c6-42d1-976f-000b3eb3ebfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:57.487316 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-3d3c0a88-03c6-42d1-976f-000b3eb3ebfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:57.494918 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3d3c0a88-03c6-42d1-976f-000b3eb3ebfe tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1265 microversion: 2.1 time: 0.152483 Feb 21 04:27:57.495467 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 556/1106] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:57 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:58.511003 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f1521a79-b40c-41a4-83fe-5d3e73b02a2b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:58.511602 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f1521a79-b40c-41a4-83fe-5d3e73b02a2b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:58.517815 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f1521a79-b40c-41a4-83fe-5d3e73b02a2b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:58.518256 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f1521a79-b40c-41a4-83fe-5d3e73b02a2b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:58.519050 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f1521a79-b40c-41a4-83fe-5d3e73b02a2b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:58.520083 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f1521a79-b40c-41a4-83fe-5d3e73b02a2b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:58.655439 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f1521a79-b40c-41a4-83fe-5d3e73b02a2b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:58.662835 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f1521a79-b40c-41a4-83fe-5d3e73b02a2b tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1265 microversion: 2.1 time: 0.155420 Feb 21 04:27:58.663402 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 551/1107] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:58 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:27:59.679170 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a0e9f7a7-0d3b-43c7-a566-6fbb752b4188 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:27:59.679820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a0e9f7a7-0d3b-43c7-a566-6fbb752b4188 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:27:59.686068 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a0e9f7a7-0d3b-43c7-a566-6fbb752b4188 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:59.686518 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a0e9f7a7-0d3b-43c7-a566-6fbb752b4188 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:59.687292 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a0e9f7a7-0d3b-43c7-a566-6fbb752b4188 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:27:59.687732 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a0e9f7a7-0d3b-43c7-a566-6fbb752b4188 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:27:59.823437 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a0e9f7a7-0d3b-43c7-a566-6fbb752b4188 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:27:59.830739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a0e9f7a7-0d3b-43c7-a566-6fbb752b4188 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1265 microversion: 2.1 time: 0.155242 Feb 21 04:27:59.831294 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 557/1108] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:27:59 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:00.847620 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-aece4c98-b3f2-4230-b7b7-27e4f1660966 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:00.848229 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-aece4c98-b3f2-4230-b7b7-27e4f1660966 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:00.854989 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aece4c98-b3f2-4230-b7b7-27e4f1660966 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:00.855430 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aece4c98-b3f2-4230-b7b7-27e4f1660966 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:00.856191 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aece4c98-b3f2-4230-b7b7-27e4f1660966 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:00.856621 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-aece4c98-b3f2-4230-b7b7-27e4f1660966 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:00.998405 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-aece4c98-b3f2-4230-b7b7-27e4f1660966 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:01.005523 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-aece4c98-b3f2-4230-b7b7-27e4f1660966 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1265 microversion: 2.1 time: 0.161507 Feb 21 04:28:01.006083 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 552/1109] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:00 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:02.022197 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-13ae27f1-bcfc-4422-95fe-43ef725eb377 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:02.022761 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-13ae27f1-bcfc-4422-95fe-43ef725eb377 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:02.029262 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-13ae27f1-bcfc-4422-95fe-43ef725eb377 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:02.029717 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-13ae27f1-bcfc-4422-95fe-43ef725eb377 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:02.030553 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-13ae27f1-bcfc-4422-95fe-43ef725eb377 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:02.030930 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-13ae27f1-bcfc-4422-95fe-43ef725eb377 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:02.165452 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-13ae27f1-bcfc-4422-95fe-43ef725eb377 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:02.172531 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-13ae27f1-bcfc-4422-95fe-43ef725eb377 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1265 microversion: 2.1 time: 0.154070 Feb 21 04:28:02.173113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 558/1110] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:02 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:03.189871 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7b94feef-8e91-41a2-a0cb-2888daa6d11c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:03.190494 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7b94feef-8e91-41a2-a0cb-2888daa6d11c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:03.197289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7b94feef-8e91-41a2-a0cb-2888daa6d11c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:03.197729 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7b94feef-8e91-41a2-a0cb-2888daa6d11c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:03.198492 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7b94feef-8e91-41a2-a0cb-2888daa6d11c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:03.198923 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7b94feef-8e91-41a2-a0cb-2888daa6d11c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:03.331440 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7b94feef-8e91-41a2-a0cb-2888daa6d11c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:03.338660 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7b94feef-8e91-41a2-a0cb-2888daa6d11c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1265 microversion: 2.1 time: 0.152451 Feb 21 04:28:03.339231 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 553/1111] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:03 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:04.354681 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e4ad3494-69a6-457b-b416-f7b719881ec1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:04.355296 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e4ad3494-69a6-457b-b416-f7b719881ec1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:04.361610 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e4ad3494-69a6-457b-b416-f7b719881ec1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:04.362057 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e4ad3494-69a6-457b-b416-f7b719881ec1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:04.362832 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e4ad3494-69a6-457b-b416-f7b719881ec1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:04.363265 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e4ad3494-69a6-457b-b416-f7b719881ec1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:04.498066 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e4ad3494-69a6-457b-b416-f7b719881ec1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:04.505985 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e4ad3494-69a6-457b-b416-f7b719881ec1 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1265 microversion: 2.1 time: 0.154942 Feb 21 04:28:04.506533 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 559/1112] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:04 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:05.523448 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-9574efbd-115a-4ad0-a147-4628278be5a7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:05.524051 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-9574efbd-115a-4ad0-a147-4628278be5a7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:05.530723 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9574efbd-115a-4ad0-a147-4628278be5a7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:05.531170 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9574efbd-115a-4ad0-a147-4628278be5a7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:05.531949 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9574efbd-115a-4ad0-a147-4628278be5a7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:05.532384 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-9574efbd-115a-4ad0-a147-4628278be5a7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:05.664502 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-9574efbd-115a-4ad0-a147-4628278be5a7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:05.671698 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-9574efbd-115a-4ad0-a147-4628278be5a7 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1265 microversion: 2.1 time: 0.152433 Feb 21 04:28:05.672262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 554/1113] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:05 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:06.688310 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-45d569a6-4ef7-4f65-a23d-e830d6b42cdd tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:06.688994 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-45d569a6-4ef7-4f65-a23d-e830d6b42cdd tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:06.695343 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-45d569a6-4ef7-4f65-a23d-e830d6b42cdd tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:06.695795 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-45d569a6-4ef7-4f65-a23d-e830d6b42cdd tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:06.696574 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-45d569a6-4ef7-4f65-a23d-e830d6b42cdd tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:06.697041 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-45d569a6-4ef7-4f65-a23d-e830d6b42cdd tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:06.830100 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-45d569a6-4ef7-4f65-a23d-e830d6b42cdd tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:06.837357 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-45d569a6-4ef7-4f65-a23d-e830d6b42cdd tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1265 microversion: 2.1 time: 0.152771 Feb 21 04:28:06.837918 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 560/1114] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:06 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:07.853875 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ece13d77-0d93-4f3b-92d3-e213041ab227 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:07.854474 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ece13d77-0d93-4f3b-92d3-e213041ab227 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:07.860647 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ece13d77-0d93-4f3b-92d3-e213041ab227 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:07.861104 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ece13d77-0d93-4f3b-92d3-e213041ab227 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:07.861864 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ece13d77-0d93-4f3b-92d3-e213041ab227 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:07.862290 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ece13d77-0d93-4f3b-92d3-e213041ab227 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:07.994080 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ece13d77-0d93-4f3b-92d3-e213041ab227 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:08.001710 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ece13d77-0d93-4f3b-92d3-e213041ab227 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1265 microversion: 2.1 time: 0.151443 Feb 21 04:28:08.002280 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 555/1115] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:07 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:08.108548 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-10891129-9a0b-4e6a-acad-c3d48ab6c093 req-c8f8ec86-a156-4142-aed8-2f0c222cc1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183ac1ab-bbc7-45b8-854d-c2a58fa0efdb", "name": "network-vif-plugged", "status": "completed", "tag": "35b91d10-b47f-430e-984b-065790ea3b32"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:28:08.110201 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:28:08.110201 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:28:08.120034 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-10891129-9a0b-4e6a-acad-c3d48ab6c093 req-c8f8ec86-a156-4142-aed8-2f0c222cc1be service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:08.120493 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-10891129-9a0b-4e6a-acad-c3d48ab6c093 req-c8f8ec86-a156-4142-aed8-2f0c222cc1be service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:08.131754 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-10891129-9a0b-4e6a-acad-c3d48ab6c093 req-c8f8ec86-a156-4142-aed8-2f0c222cc1be service nova] Creating event network-vif-plugged:35b91d10-b47f-430e-984b-065790ea3b32 for instance 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb on hv-cinder-77398 Feb 21 04:28:08.136762 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-10891129-9a0b-4e6a-acad-c3d48ab6c093 req-c8f8ec86-a156-4142-aed8-2f0c222cc1be service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031778 Feb 21 04:28:08.137342 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 561/1116] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:28:09.018956 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7bb2f6aa-c9c5-4732-9e92-69818b107d6d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:09.019535 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7bb2f6aa-c9c5-4732-9e92-69818b107d6d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:09.026407 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7bb2f6aa-c9c5-4732-9e92-69818b107d6d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:09.026850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7bb2f6aa-c9c5-4732-9e92-69818b107d6d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:09.027876 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7bb2f6aa-c9c5-4732-9e92-69818b107d6d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:09.028315 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7bb2f6aa-c9c5-4732-9e92-69818b107d6d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:09.157019 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-7bb2f6aa-c9c5-4732-9e92-69818b107d6d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:09.164157 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7bb2f6aa-c9c5-4732-9e92-69818b107d6d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1265 microversion: 2.1 time: 0.148901 Feb 21 04:28:09.164748 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 556/1117] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:09 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:10.181964 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fc427239-6ada-4136-8b63-4ddcce641833 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:10.182666 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fc427239-6ada-4136-8b63-4ddcce641833 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:10.189149 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fc427239-6ada-4136-8b63-4ddcce641833 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:10.189603 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fc427239-6ada-4136-8b63-4ddcce641833 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:10.190381 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fc427239-6ada-4136-8b63-4ddcce641833 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:10.190820 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fc427239-6ada-4136-8b63-4ddcce641833 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:10.326047 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-fc427239-6ada-4136-8b63-4ddcce641833 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:10.333562 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fc427239-6ada-4136-8b63-4ddcce641833 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1453 microversion: 2.1 time: 0.155619 Feb 21 04:28:10.334131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 562/1118] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:10 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:10.349649 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6c274fa7-d71a-4452-8d68-fafaada30bac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:10.350261 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6c274fa7-d71a-4452-8d68-fafaada30bac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:10.356424 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6c274fa7-d71a-4452-8d68-fafaada30bac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:10.356913 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6c274fa7-d71a-4452-8d68-fafaada30bac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:10.357687 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6c274fa7-d71a-4452-8d68-fafaada30bac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:10.358123 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6c274fa7-d71a-4452-8d68-fafaada30bac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:10.488216 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6c274fa7-d71a-4452-8d68-fafaada30bac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:10.496091 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6c274fa7-d71a-4452-8d68-fafaada30bac tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1453 microversion: 2.1 time: 0.150615 Feb 21 04:28:10.496668 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 557/1119] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:10 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:12.434516 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-1f081c96-486e-43fa-a83e-65e887bf7343 req-09191c51-e9b0-47ed-a86e-3fd8b58b1958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183ac1ab-bbc7-45b8-854d-c2a58fa0efdb", "tag": "35b91d10-b47f-430e-984b-065790ea3b32"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:28:12.436215 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:28:12.436215 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:28:12.443705 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-1f081c96-486e-43fa-a83e-65e887bf7343 req-09191c51-e9b0-47ed-a86e-3fd8b58b1958 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:12.444225 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-1f081c96-486e-43fa-a83e-65e887bf7343 req-09191c51-e9b0-47ed-a86e-3fd8b58b1958 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:12.455067 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-1f081c96-486e-43fa-a83e-65e887bf7343 req-09191c51-e9b0-47ed-a86e-3fd8b58b1958 service nova] Creating event network-changed:35b91d10-b47f-430e-984b-065790ea3b32 for instance 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb on hv-cinder-77398 Feb 21 04:28:12.460754 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-1f081c96-486e-43fa-a83e-65e887bf7343 req-09191c51-e9b0-47ed-a86e-3fd8b58b1958 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029874 Feb 21 04:28:12.461346 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 563/1120] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:28:21.385645 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:28:21.386238 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: Mon Feb 21 04:28:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:28:28.451639 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6b759fd6-ce56-446b-85d3-8ca4f5585b3a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:28.452264 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6b759fd6-ce56-446b-85d3-8ca4f5585b3a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:28.457937 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6b759fd6-ce56-446b-85d3-8ca4f5585b3a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:28.458382 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6b759fd6-ce56-446b-85d3-8ca4f5585b3a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:28.459148 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6b759fd6-ce56-446b-85d3-8ca4f5585b3a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:28.460202 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6b759fd6-ce56-446b-85d3-8ca4f5585b3a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:28.542679 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-6b759fd6-ce56-446b-85d3-8ca4f5585b3a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lazy-loading 'services' on Instance uuid 93b3eafa-8661-45e6-a0ae-920c3499ae2f {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:28:28.617170 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6b759fd6-ce56-446b-85d3-8ca4f5585b3a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "DELETE /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/os-volume_attachments/7b98d95b-1902-45ea-ba5a-c348c5b038bc" status: 202 len: 0 microversion: 2.1 time: 0.169251 Feb 21 04:28:28.617741 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 558/1121] 10.222.0.10 () {58 vars in 1415 bytes} [Mon Feb 21 04:28:28 2022] DELETE /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/os-volume_attachments/7b98d95b-1902-45ea-ba5a-c348c5b038bc => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:28:29.721969 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-cf0de898-f5ec-4a30-9101-074db9b27c45 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:28:29.728579 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cf0de898-f5ec-4a30-9101-074db9b27c45 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:29.729054 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-cf0de898-f5ec-4a30-9101-074db9b27c45 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:29.788225 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-cf0de898-f5ec-4a30-9101-074db9b27c45 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Going to try to stop instance {{(pid=116571) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 21 04:28:29.829237 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-cf0de898-f5ec-4a30-9101-074db9b27c45 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "POST /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/action" status: 202 len: 0 microversion: 2.1 time: 0.111604 Feb 21 04:28:29.829818 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 564/1122] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:28:29 2022] POST /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:28:29.839485 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-48c0b9f4-8f89-44ac-ae69-980a2e8062f3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:29.840278 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-48c0b9f4-8f89-44ac-ae69-980a2e8062f3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:29.847123 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-48c0b9f4-8f89-44ac-ae69-980a2e8062f3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:29.847660 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-48c0b9f4-8f89-44ac-ae69-980a2e8062f3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:29.848497 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-48c0b9f4-8f89-44ac-ae69-980a2e8062f3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:29.849209 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-48c0b9f4-8f89-44ac-ae69-980a2e8062f3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:29.989768 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-48c0b9f4-8f89-44ac-ae69-980a2e8062f3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:29.997103 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-48c0b9f4-8f89-44ac-ae69-980a2e8062f3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1675 microversion: 2.1 time: 0.162595 Feb 21 04:28:29.997664 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 559/1123] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:29 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:31.015391 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9bc5884e-dd2d-44f8-bb16-7d34cab48360 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:31.016120 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9bc5884e-dd2d-44f8-bb16-7d34cab48360 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:31.022922 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9bc5884e-dd2d-44f8-bb16-7d34cab48360 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:31.023301 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9bc5884e-dd2d-44f8-bb16-7d34cab48360 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:31.024097 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9bc5884e-dd2d-44f8-bb16-7d34cab48360 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:31.024528 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9bc5884e-dd2d-44f8-bb16-7d34cab48360 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:31.156682 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9bc5884e-dd2d-44f8-bb16-7d34cab48360 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:31.164468 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9bc5884e-dd2d-44f8-bb16-7d34cab48360 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1675 microversion: 2.1 time: 0.153518 Feb 21 04:28:31.165057 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 565/1124] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:31 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:32.182887 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-94efabb8-29b0-41e9-afe6-5ede597c775a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:32.184024 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-94efabb8-29b0-41e9-afe6-5ede597c775a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:32.194493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-94efabb8-29b0-41e9-afe6-5ede597c775a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:32.194944 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-94efabb8-29b0-41e9-afe6-5ede597c775a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:32.196392 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-94efabb8-29b0-41e9-afe6-5ede597c775a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:32.196863 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-94efabb8-29b0-41e9-afe6-5ede597c775a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:32.322379 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-94efabb8-29b0-41e9-afe6-5ede597c775a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:32.329528 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-94efabb8-29b0-41e9-afe6-5ede597c775a tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1675 microversion: 2.1 time: 0.151376 Feb 21 04:28:32.330096 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 560/1125] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:32 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:33.346707 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-aaeaff37-cabe-4a6a-b593-16af1f47b812 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:33.347319 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-aaeaff37-cabe-4a6a-b593-16af1f47b812 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:33.353690 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-aaeaff37-cabe-4a6a-b593-16af1f47b812 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:33.354143 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-aaeaff37-cabe-4a6a-b593-16af1f47b812 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:33.354914 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-aaeaff37-cabe-4a6a-b593-16af1f47b812 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:33.355349 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-aaeaff37-cabe-4a6a-b593-16af1f47b812 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:33.487249 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-aaeaff37-cabe-4a6a-b593-16af1f47b812 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:33.506556 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-aaeaff37-cabe-4a6a-b593-16af1f47b812 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1675 microversion: 2.1 time: 0.153821 Feb 21 04:28:33.507143 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 566/1126] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:33 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:34.524245 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b3f92331-7cb2-46b7-b72d-f040076e06b6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:34.524887 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b3f92331-7cb2-46b7-b72d-f040076e06b6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:34.531340 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b3f92331-7cb2-46b7-b72d-f040076e06b6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:34.531784 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b3f92331-7cb2-46b7-b72d-f040076e06b6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:34.532550 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b3f92331-7cb2-46b7-b72d-f040076e06b6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:34.533000 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b3f92331-7cb2-46b7-b72d-f040076e06b6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:34.660195 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b3f92331-7cb2-46b7-b72d-f040076e06b6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:34.667295 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b3f92331-7cb2-46b7-b72d-f040076e06b6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1675 microversion: 2.1 time: 0.147395 Feb 21 04:28:34.667847 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 561/1127] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:34 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:35.683917 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-88775b43-a24a-46ca-ac33-cd28415d1b0d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:35.684515 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-88775b43-a24a-46ca-ac33-cd28415d1b0d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:35.690731 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-88775b43-a24a-46ca-ac33-cd28415d1b0d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:35.691179 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-88775b43-a24a-46ca-ac33-cd28415d1b0d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:35.691952 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-88775b43-a24a-46ca-ac33-cd28415d1b0d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:35.692388 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-88775b43-a24a-46ca-ac33-cd28415d1b0d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:35.820509 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-88775b43-a24a-46ca-ac33-cd28415d1b0d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:35.827701 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-88775b43-a24a-46ca-ac33-cd28415d1b0d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1675 microversion: 2.1 time: 0.147490 Feb 21 04:28:35.828347 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 567/1128] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:35 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:36.844583 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-18e4623b-7456-4f43-8556-eb56ddecfd94 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:36.845218 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-18e4623b-7456-4f43-8556-eb56ddecfd94 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:36.852282 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18e4623b-7456-4f43-8556-eb56ddecfd94 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:36.852751 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18e4623b-7456-4f43-8556-eb56ddecfd94 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:36.853526 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18e4623b-7456-4f43-8556-eb56ddecfd94 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:36.853986 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-18e4623b-7456-4f43-8556-eb56ddecfd94 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:36.983204 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-18e4623b-7456-4f43-8556-eb56ddecfd94 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:36.991300 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-18e4623b-7456-4f43-8556-eb56ddecfd94 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1675 microversion: 2.1 time: 0.150383 Feb 21 04:28:36.991859 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 562/1129] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:36 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:38.007996 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b11804e3-f5f3-4656-bc1e-b977e1f3ccbe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:38.008657 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b11804e3-f5f3-4656-bc1e-b977e1f3ccbe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:38.014923 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b11804e3-f5f3-4656-bc1e-b977e1f3ccbe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:38.015374 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b11804e3-f5f3-4656-bc1e-b977e1f3ccbe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:38.016146 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b11804e3-f5f3-4656-bc1e-b977e1f3ccbe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:38.016581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b11804e3-f5f3-4656-bc1e-b977e1f3ccbe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:38.145239 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b11804e3-f5f3-4656-bc1e-b977e1f3ccbe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:38.153293 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b11804e3-f5f3-4656-bc1e-b977e1f3ccbe tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1675 microversion: 2.1 time: 0.149177 Feb 21 04:28:38.153856 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 568/1130] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:38 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:39.170558 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0c0f4274-40e8-4b39-a4b5-dfee37650121 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:39.171169 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0c0f4274-40e8-4b39-a4b5-dfee37650121 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:39.177419 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0c0f4274-40e8-4b39-a4b5-dfee37650121 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:39.177870 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0c0f4274-40e8-4b39-a4b5-dfee37650121 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:39.178643 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0c0f4274-40e8-4b39-a4b5-dfee37650121 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:39.179079 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0c0f4274-40e8-4b39-a4b5-dfee37650121 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:39.314431 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0c0f4274-40e8-4b39-a4b5-dfee37650121 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:39.321731 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0c0f4274-40e8-4b39-a4b5-dfee37650121 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1675 microversion: 2.1 time: 0.154850 Feb 21 04:28:39.322293 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 563/1131] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:39 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:40.338733 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-06c5bf92-c363-4e49-82b2-772f26ca2528 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:40.339328 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-06c5bf92-c363-4e49-82b2-772f26ca2528 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:40.345588 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-06c5bf92-c363-4e49-82b2-772f26ca2528 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:40.346046 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-06c5bf92-c363-4e49-82b2-772f26ca2528 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:40.346895 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-06c5bf92-c363-4e49-82b2-772f26ca2528 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:40.347253 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-06c5bf92-c363-4e49-82b2-772f26ca2528 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:40.474137 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-06c5bf92-c363-4e49-82b2-772f26ca2528 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:40.481838 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-06c5bf92-c363-4e49-82b2-772f26ca2528 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1652 microversion: 2.1 time: 0.146767 Feb 21 04:28:40.482397 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 569/1132] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:40 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1652 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:40.498315 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e40230dc-5dcd-4aae-8729-0d6efe1ae4f2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:28:40.504595 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e40230dc-5dcd-4aae-8729-0d6efe1ae4f2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:40.505090 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e40230dc-5dcd-4aae-8729-0d6efe1ae4f2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:40.526373 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e40230dc-5dcd-4aae-8729-0d6efe1ae4f2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Going to try to start instance {{(pid=116570) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 21 04:28:40.567043 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e40230dc-5dcd-4aae-8729-0d6efe1ae4f2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "POST /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/action" status: 202 len: 0 microversion: 2.1 time: 0.072308 Feb 21 04:28:40.567831 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 564/1133] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:28:40 2022] POST /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:28:40.575728 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-dee488a0-762e-4976-b5a6-9bb986bd46a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:40.576343 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-dee488a0-762e-4976-b5a6-9bb986bd46a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:40.582533 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dee488a0-762e-4976-b5a6-9bb986bd46a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:40.582997 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dee488a0-762e-4976-b5a6-9bb986bd46a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:40.584022 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dee488a0-762e-4976-b5a6-9bb986bd46a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:40.585167 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-dee488a0-762e-4976-b5a6-9bb986bd46a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:40.721514 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-dee488a0-762e-4976-b5a6-9bb986bd46a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:40.729484 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-dee488a0-762e-4976-b5a6-9bb986bd46a6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1661 microversion: 2.1 time: 0.157397 Feb 21 04:28:40.730126 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 570/1134] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:40 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1661 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:28:41.746778 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5fe069a4-5bfa-4d5c-b5ee-85eeea015282 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:28:41.747467 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5fe069a4-5bfa-4d5c-b5ee-85eeea015282 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:28:41.754039 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5fe069a4-5bfa-4d5c-b5ee-85eeea015282 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:41.754486 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5fe069a4-5bfa-4d5c-b5ee-85eeea015282 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:41.755251 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5fe069a4-5bfa-4d5c-b5ee-85eeea015282 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:28:41.755682 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5fe069a4-5bfa-4d5c-b5ee-85eeea015282 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:28:41.886202 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5fe069a4-5bfa-4d5c-b5ee-85eeea015282 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:28:41.893417 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5fe069a4-5bfa-4d5c-b5ee-85eeea015282 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1665 microversion: 2.1 time: 0.151233 Feb 21 04:28:41.893981 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 565/1135] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:28:41 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:29:45.179945 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-38ffdee6-6dec-47d3-9a65-2cf602658ad5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:45.180945 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-38ffdee6-6dec-47d3-9a65-2cf602658ad5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:45.186803 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-38ffdee6-6dec-47d3-9a65-2cf602658ad5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:45.187251 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-38ffdee6-6dec-47d3-9a65-2cf602658ad5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:45.188016 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-38ffdee6-6dec-47d3-9a65-2cf602658ad5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:45.188446 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-38ffdee6-6dec-47d3-9a65-2cf602658ad5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:45.216124 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-38ffdee6-6dec-47d3-9a65-2cf602658ad5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040822 Feb 21 04:29:45.216678 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 571/1136] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:29:45 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 04:29:45.270449 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-cec2edb6-abcb-4f79-a0d5-40750080f5eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:45.270954 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-cec2edb6-abcb-4f79-a0d5-40750080f5eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:45.277157 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cec2edb6-abcb-4f79-a0d5-40750080f5eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:45.277875 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cec2edb6-abcb-4f79-a0d5-40750080f5eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:45.278653 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cec2edb6-abcb-4f79-a0d5-40750080f5eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:45.279126 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-cec2edb6-abcb-4f79-a0d5-40750080f5eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:45.304820 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-cec2edb6-abcb-4f79-a0d5-40750080f5eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Going to try to terminate instance {{(pid=116570) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:29:45.377950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-cec2edb6-abcb-4f79-a0d5-40750080f5eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "DELETE /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 204 len: 0 microversion: 2.1 time: 0.111751 Feb 21 04:29:45.379016 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 566/1137] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:29:45 2022] DELETE /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:29:45.387229 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5b40e147-8446-48a0-afe6-7a74030f7fc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:45.387845 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5b40e147-8446-48a0-afe6-7a74030f7fc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:45.393678 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5b40e147-8446-48a0-afe6-7a74030f7fc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:45.394135 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5b40e147-8446-48a0-afe6-7a74030f7fc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:45.394907 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5b40e147-8446-48a0-afe6-7a74030f7fc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:45.395343 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5b40e147-8446-48a0-afe6-7a74030f7fc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:45.602829 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5b40e147-8446-48a0-afe6-7a74030f7fc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:29:45.610139 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5b40e147-8446-48a0-afe6-7a74030f7fc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1671 microversion: 2.1 time: 0.226976 Feb 21 04:29:45.610698 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 572/1138] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:29:45 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1671 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:29:46.627645 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2b38b932-9c37-47df-92c2-3ab928750b7c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:46.628346 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2b38b932-9c37-47df-92c2-3ab928750b7c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:46.634787 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2b38b932-9c37-47df-92c2-3ab928750b7c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:46.635239 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2b38b932-9c37-47df-92c2-3ab928750b7c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:46.636015 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2b38b932-9c37-47df-92c2-3ab928750b7c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:46.636450 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2b38b932-9c37-47df-92c2-3ab928750b7c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:46.817228 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-2b38b932-9c37-47df-92c2-3ab928750b7c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:29:46.824926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2b38b932-9c37-47df-92c2-3ab928750b7c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1671 microversion: 2.1 time: 0.201414 Feb 21 04:29:46.825482 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 567/1139] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:29:46 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1671 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:29:47.841993 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1150cddd-d012-4cd2-b59a-e840fa1a264b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:47.843282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1150cddd-d012-4cd2-b59a-e840fa1a264b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:47.849641 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1150cddd-d012-4cd2-b59a-e840fa1a264b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:47.850090 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1150cddd-d012-4cd2-b59a-e840fa1a264b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:47.850913 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1150cddd-d012-4cd2-b59a-e840fa1a264b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:47.851351 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1150cddd-d012-4cd2-b59a-e840fa1a264b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:47.981794 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1150cddd-d012-4cd2-b59a-e840fa1a264b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:29:47.989130 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1150cddd-d012-4cd2-b59a-e840fa1a264b tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1671 microversion: 2.1 time: 0.150904 Feb 21 04:29:47.989945 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 573/1140] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:29:47 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:29:48.811641 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-00f820df-d4b0-4a53-ae14-b07906ee2a21 req-df45c964-2059-43c5-9b4a-e76c2e8e046b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b3eafa-8661-45e6-a0ae-920c3499ae2f", "name": "network-vif-deleted", "tag": "0b5c4c14-36fb-4fa3-a6c2-612571e2855a"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:29:48.814697 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:29:48.814697 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:29:48.824757 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-00f820df-d4b0-4a53-ae14-b07906ee2a21 req-df45c964-2059-43c5-9b4a-e76c2e8e046b service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:48.825200 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-00f820df-d4b0-4a53-ae14-b07906ee2a21 req-df45c964-2059-43c5-9b4a-e76c2e8e046b service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:48.837594 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-00f820df-d4b0-4a53-ae14-b07906ee2a21 req-df45c964-2059-43c5-9b4a-e76c2e8e046b service nova] Creating event network-vif-deleted:0b5c4c14-36fb-4fa3-a6c2-612571e2855a for instance 93b3eafa-8661-45e6-a0ae-920c3499ae2f on hv-cinder-77398 Feb 21 04:29:48.843818 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-00f820df-d4b0-4a53-ae14-b07906ee2a21 req-df45c964-2059-43c5-9b4a-e76c2e8e046b service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035770 Feb 21 04:29:48.844473 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 568/1141] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:29:49.005214 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a4a0f02a-5115-42f7-8214-5ea033f96d90 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:49.005867 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a4a0f02a-5115-42f7-8214-5ea033f96d90 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:49.012539 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a4a0f02a-5115-42f7-8214-5ea033f96d90 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:49.013026 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a4a0f02a-5115-42f7-8214-5ea033f96d90 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:49.013812 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a4a0f02a-5115-42f7-8214-5ea033f96d90 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:49.014253 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a4a0f02a-5115-42f7-8214-5ea033f96d90 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:49.043976 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a4a0f02a-5115-42f7-8214-5ea033f96d90 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:49.044433 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a4a0f02a-5115-42f7-8214-5ea033f96d90 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:49.044928 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-a4a0f02a-5115-42f7-8214-5ea033f96d90 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lazy-loading 'fault' on Instance uuid 93b3eafa-8661-45e6-a0ae-920c3499ae2f {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:29:49.109341 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a4a0f02a-5115-42f7-8214-5ea033f96d90 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:29:49.117114 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a4a0f02a-5115-42f7-8214-5ea033f96d90 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 200 len: 1326 microversion: 2.1 time: 0.115436 Feb 21 04:29:49.117944 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 574/1142] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:29:49 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:29:50.134826 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-081b5fff-3e3e-444c-92d6-bd02ce2071d5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:50.135550 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-081b5fff-3e3e-444c-92d6-bd02ce2071d5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:50.141980 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-081b5fff-3e3e-444c-92d6-bd02ce2071d5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:50.142424 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-081b5fff-3e3e-444c-92d6-bd02ce2071d5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:50.143186 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-081b5fff-3e3e-444c-92d6-bd02ce2071d5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:50.143620 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-081b5fff-3e3e-444c-92d6-bd02ce2071d5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:50.158801 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-081b5fff-3e3e-444c-92d6-bd02ce2071d5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] HTTP exception thrown: Instance 93b3eafa-8661-45e6-a0ae-920c3499ae2f could not be found. Feb 21 04:29:50.159384 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-081b5fff-3e3e-444c-92d6-bd02ce2071d5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Returning 404 to user: Instance 93b3eafa-8661-45e6-a0ae-920c3499ae2f could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:29:50.160198 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-081b5fff-3e3e-444c-92d6-bd02ce2071d5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 404 len: 111 microversion: 2.1 time: 0.029889 Feb 21 04:29:50.160749 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 569/1143] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:29:50 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:29:50.168982 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-3deb5f2a-7892-4e80-b475-14e395755e64 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '.version_select at 0x7feee0e4a430>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:50.185739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-3deb5f2a-7892-4e80-b475-14e395755e64 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-442477199" status: 202 len: 0 microversion: 2.1 time: 0.020449 Feb 21 04:29:50.186285 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 575/1144] 10.222.0.10 () {58 vars in 1217 bytes} [Mon Feb 21 04:29:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-442477199 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:29:50.806979 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d5438fea-7b7a-4d64-b993-361cf61d04bd tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Action: 'create', calling method: .version_select at 0x7feee145fb80>, body: {"keypair": {"name": "tempest-keypair-1361640865"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:29:50.820153 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-d5438fea-7b7a-4d64-b993-361cf61d04bd tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Getting quotas for project e95f468f72044118862b24027a3667e1. Resources: {'key_pairs'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:29:50.824289 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-d5438fea-7b7a-4d64-b993-361cf61d04bd tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Getting quotas for user d165f2d03fdd43069795313e84816e72 and project e95f468f72044118862b24027a3667e1. Resources: {'key_pairs'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:29:51.074996 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-d5438fea-7b7a-4d64-b993-361cf61d04bd tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Getting quotas for project e95f468f72044118862b24027a3667e1. Resources: {'key_pairs'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:29:51.081451 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-d5438fea-7b7a-4d64-b993-361cf61d04bd tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Getting quotas for user d165f2d03fdd43069795313e84816e72 and project e95f468f72044118862b24027a3667e1. Resources: {'key_pairs'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:29:51.095417 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d5438fea-7b7a-4d64-b993-361cf61d04bd tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.292138 Feb 21 04:29:51.096008 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 570/1145] 10.222.0.10 () {60 vars in 1157 bytes} [Mon Feb 21 04:29:50 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:29:52.356831 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-172407300", "imageRef": "4140a7c2-5356-4ad7-afff-f251cb3175c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c9062fa-aec5-48ac-8813-607eff1131a5"}], "security_groups": [{"name": "tempest-securitygroup--2059222358"}], "key_name": "tempest-keypair-1361640865", "user_data": "}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:29:52.455212 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.network.neutron [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] validate_networks() for [('3c9062fa-aec5-48ac-8813-607eff1131a5', None, None, None, None, None)] {{(pid=116571) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:29:52.811445 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Flavor limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:29:52.811891 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Image limits 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:29:52.812360 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Flavor pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:29:52.812799 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Image pref 0:0:0 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:29:52.813209 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.virt.hardware [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:29:52.822222 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:52.822666 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:52.823470 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:52.823905 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:52.840064 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Getting quotas for project e95f468f72044118862b24027a3667e1. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:29:52.844032 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Getting quotas for user d165f2d03fdd43069795313e84816e72 and project e95f468f72044118862b24027a3667e1. Resources: {'instances', 'cores', 'ram'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:29:52.854581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Going to run 1 instances... {{(pid=116571) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:29:52.856962 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4140a7c2-5356-4ad7-afff-f251cb3175c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:29:52.903117 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7dbf2c58-3fbc-4317-9702-6e7666ff0f63 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.551134 Feb 21 04:29:52.903830 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 576/1146] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:29:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:29:52.914167 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0633bb2d-aa0c-4bb8-96ee-3400d0d06cd2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:52.914786 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0633bb2d-aa0c-4bb8-96ee-3400d0d06cd2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:52.968252 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0633bb2d-aa0c-4bb8-96ee-3400d0d06cd2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:29:52.974612 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0633bb2d-aa0c-4bb8-96ee-3400d0d06cd2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1237 microversion: 2.1 time: 0.064574 Feb 21 04:29:52.975171 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 571/1147] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:29:52 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:29:53.991224 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-34e0dea0-e03f-4c6a-9ad1-6c172d5690b7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:53.991819 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-34e0dea0-e03f-4c6a-9ad1-6c172d5690b7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:53.998744 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-34e0dea0-e03f-4c6a-9ad1-6c172d5690b7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:53.999190 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-34e0dea0-e03f-4c6a-9ad1-6c172d5690b7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:53.999962 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-34e0dea0-e03f-4c6a-9ad1-6c172d5690b7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:54.000396 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-34e0dea0-e03f-4c6a-9ad1-6c172d5690b7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:54.070635 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-34e0dea0-e03f-4c6a-9ad1-6c172d5690b7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:29:54.078017 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-34e0dea0-e03f-4c6a-9ad1-6c172d5690b7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1295 microversion: 2.1 time: 0.090608 Feb 21 04:29:54.078577 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 577/1148] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:29:53 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:29:55.079347 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-e1729162-68a2-4672-8654-62bab3fc89ae req-a58e2ece-98a9-42d2-97ae-95db9e5b3b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5988e9b3-4462-49f4-9bbc-bab50ecf0d9c", "tag": "a4dcaec8-ba6f-42d9-859e-cf2a72be0b5d"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:29:55.085153 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:29:55.085153 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:29:55.095892 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d78596ec-c053-4a46-9311-8164567d1a07 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:55.097188 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d78596ec-c053-4a46-9311-8164567d1a07 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:55.106425 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-e1729162-68a2-4672-8654-62bab3fc89ae req-a58e2ece-98a9-42d2-97ae-95db9e5b3b89 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:55.106872 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-e1729162-68a2-4672-8654-62bab3fc89ae req-a58e2ece-98a9-42d2-97ae-95db9e5b3b89 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:55.112128 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d78596ec-c053-4a46-9311-8164567d1a07 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:55.112581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d78596ec-c053-4a46-9311-8164567d1a07 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:55.113404 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d78596ec-c053-4a46-9311-8164567d1a07 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:55.113844 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d78596ec-c053-4a46-9311-8164567d1a07 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:55.133780 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-e1729162-68a2-4672-8654-62bab3fc89ae req-a58e2ece-98a9-42d2-97ae-95db9e5b3b89 service nova] Creating event network-changed:a4dcaec8-ba6f-42d9-859e-cf2a72be0b5d for instance 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c on hv-cinder-77398 Feb 21 04:29:55.139136 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-e1729162-68a2-4672-8654-62bab3fc89ae req-a58e2ece-98a9-42d2-97ae-95db9e5b3b89 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064737 Feb 21 04:29:55.140019 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 572/1149] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:29:55.268896 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-d78596ec-c053-4a46-9311-8164567d1a07 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:29:55.277300 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d78596ec-c053-4a46-9311-8164567d1a07 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1363 microversion: 2.1 time: 0.185601 Feb 21 04:29:55.278182 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 578/1150] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:29:55 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:29:56.295928 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b8a33acf-de27-4c8e-b496-6368fd0d4b0e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:56.296677 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b8a33acf-de27-4c8e-b496-6368fd0d4b0e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:56.302779 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8a33acf-de27-4c8e-b496-6368fd0d4b0e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:56.303224 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8a33acf-de27-4c8e-b496-6368fd0d4b0e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:56.304027 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8a33acf-de27-4c8e-b496-6368fd0d4b0e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:56.304456 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8a33acf-de27-4c8e-b496-6368fd0d4b0e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:56.433555 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-b8a33acf-de27-4c8e-b496-6368fd0d4b0e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:29:56.440934 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b8a33acf-de27-4c8e-b496-6368fd0d4b0e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1363 microversion: 2.1 time: 0.150063 Feb 21 04:29:56.441503 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 573/1151] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:29:56 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:29:57.458037 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-fa706fad-ef21-4315-bc45-4105440ceba1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:57.458657 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-fa706fad-ef21-4315-bc45-4105440ceba1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:57.465486 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fa706fad-ef21-4315-bc45-4105440ceba1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:57.465933 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fa706fad-ef21-4315-bc45-4105440ceba1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:57.466695 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fa706fad-ef21-4315-bc45-4105440ceba1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:57.467127 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-fa706fad-ef21-4315-bc45-4105440ceba1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:57.600813 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-fa706fad-ef21-4315-bc45-4105440ceba1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:29:57.607898 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-fa706fad-ef21-4315-bc45-4105440ceba1 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1363 microversion: 2.1 time: 0.153582 Feb 21 04:29:57.608450 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 579/1152] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:29:57 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:29:58.624442 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f89771d8-dcc9-40ab-ad25-1a99de372510 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:58.625089 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f89771d8-dcc9-40ab-ad25-1a99de372510 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:58.631269 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f89771d8-dcc9-40ab-ad25-1a99de372510 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:58.631713 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f89771d8-dcc9-40ab-ad25-1a99de372510 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:58.632491 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f89771d8-dcc9-40ab-ad25-1a99de372510 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:58.632967 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f89771d8-dcc9-40ab-ad25-1a99de372510 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:58.764737 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f89771d8-dcc9-40ab-ad25-1a99de372510 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:29:58.771911 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f89771d8-dcc9-40ab-ad25-1a99de372510 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1363 microversion: 2.1 time: 0.151151 Feb 21 04:29:58.772469 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 574/1153] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:29:58 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:29:59.789303 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e6d2754e-9889-4106-981a-9b1da3925bab tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:29:59.790364 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e6d2754e-9889-4106-981a-9b1da3925bab tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:29:59.796645 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e6d2754e-9889-4106-981a-9b1da3925bab tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:59.797099 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e6d2754e-9889-4106-981a-9b1da3925bab tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:59.797861 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e6d2754e-9889-4106-981a-9b1da3925bab tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:29:59.798289 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e6d2754e-9889-4106-981a-9b1da3925bab tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:29:59.929749 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e6d2754e-9889-4106-981a-9b1da3925bab tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:29:59.937650 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e6d2754e-9889-4106-981a-9b1da3925bab tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1363 microversion: 2.1 time: 0.151994 Feb 21 04:29:59.938227 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 580/1154] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:29:59 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:30:00.649237 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-9850554c-ebc3-4a21-be4d-42c9f96b776d req-e8b884b8-49cf-4bd8-841e-6c9adcd795a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5988e9b3-4462-49f4-9bbc-bab50ecf0d9c", "name": "network-vif-plugged", "status": "completed", "tag": "a4dcaec8-ba6f-42d9-859e-cf2a72be0b5d"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:30:00.651313 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:30:00.651313 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:30:00.659602 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-9850554c-ebc3-4a21-be4d-42c9f96b776d req-e8b884b8-49cf-4bd8-841e-6c9adcd795a0 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:00.659957 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-9850554c-ebc3-4a21-be4d-42c9f96b776d req-e8b884b8-49cf-4bd8-841e-6c9adcd795a0 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:00.672495 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-9850554c-ebc3-4a21-be4d-42c9f96b776d req-e8b884b8-49cf-4bd8-841e-6c9adcd795a0 service nova] Creating event network-vif-plugged:a4dcaec8-ba6f-42d9-859e-cf2a72be0b5d for instance 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c on hv-cinder-77398 Feb 21 04:30:00.677400 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-9850554c-ebc3-4a21-be4d-42c9f96b776d req-e8b884b8-49cf-4bd8-841e-6c9adcd795a0 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031756 Feb 21 04:30:00.678006 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 575/1155] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:30:00.954419 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a6691202-1a99-4078-ae17-506d40e3d905 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:00.955229 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a6691202-1a99-4078-ae17-506d40e3d905 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:00.962786 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6691202-1a99-4078-ae17-506d40e3d905 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:00.963241 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6691202-1a99-4078-ae17-506d40e3d905 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:00.964021 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6691202-1a99-4078-ae17-506d40e3d905 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:00.964458 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a6691202-1a99-4078-ae17-506d40e3d905 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:01.095709 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-a6691202-1a99-4078-ae17-506d40e3d905 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:30:01.102899 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a6691202-1a99-4078-ae17-506d40e3d905 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1363 microversion: 2.1 time: 0.152122 Feb 21 04:30:01.103450 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 581/1156] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:30:00 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:30:02.120956 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-a2456efd-02a5-4e10-bce3-a14b0ec24d16 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:02.121608 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-a2456efd-02a5-4e10-bce3-a14b0ec24d16 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:02.127557 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a2456efd-02a5-4e10-bce3-a14b0ec24d16 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:02.128006 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a2456efd-02a5-4e10-bce3-a14b0ec24d16 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:02.128823 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a2456efd-02a5-4e10-bce3-a14b0ec24d16 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:02.129257 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-a2456efd-02a5-4e10-bce3-a14b0ec24d16 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:02.261337 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-a2456efd-02a5-4e10-bce3-a14b0ec24d16 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:30:02.268514 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-a2456efd-02a5-4e10-bce3-a14b0ec24d16 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1363 microversion: 2.1 time: 0.152169 Feb 21 04:30:02.269154 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 576/1157] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:30:02 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:30:03.285700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-b7d52157-84e5-4726-8aba-428103dc037e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:03.286311 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-b7d52157-84e5-4726-8aba-428103dc037e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:03.292722 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b7d52157-84e5-4726-8aba-428103dc037e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:03.293149 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b7d52157-84e5-4726-8aba-428103dc037e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:03.293916 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b7d52157-84e5-4726-8aba-428103dc037e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:03.294344 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-b7d52157-84e5-4726-8aba-428103dc037e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:03.433501 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-b7d52157-84e5-4726-8aba-428103dc037e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:30:03.440661 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-b7d52157-84e5-4726-8aba-428103dc037e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1548 microversion: 2.1 time: 0.158703 Feb 21 04:30:03.441210 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 582/1158] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:30:03 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:30:03.456975 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4394a628-d7a5-4d12-b75b-9f868d0e463d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:03.457473 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4394a628-d7a5-4d12-b75b-9f868d0e463d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:03.464223 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4394a628-d7a5-4d12-b75b-9f868d0e463d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:03.464691 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4394a628-d7a5-4d12-b75b-9f868d0e463d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:03.465470 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4394a628-d7a5-4d12-b75b-9f868d0e463d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:03.465906 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4394a628-d7a5-4d12-b75b-9f868d0e463d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:03.547060 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4394a628-d7a5-4d12-b75b-9f868d0e463d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093645 Feb 21 04:30:03.547650 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 577/1159] 10.222.0.10 () {58 vars in 1274 bytes} [Mon Feb 21 04:30:03 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:30:04.529182 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-421dc19b-24f1-4f6e-bee1-e6b4624944df req-9ad49882-01bd-470d-b517-ed61d5a4dd94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5988e9b3-4462-49f4-9bbc-bab50ecf0d9c", "tag": "a4dcaec8-ba6f-42d9-859e-cf2a72be0b5d"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:30:04.530695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:30:04.530695 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:30:04.534742 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7b2a518e-7b44-4b73-bfa3-4e9d1236137d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:04.535237 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7b2a518e-7b44-4b73-bfa3-4e9d1236137d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:04.542576 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7b2a518e-7b44-4b73-bfa3-4e9d1236137d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:04.543054 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7b2a518e-7b44-4b73-bfa3-4e9d1236137d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:04.543643 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-421dc19b-24f1-4f6e-bee1-e6b4624944df req-9ad49882-01bd-470d-b517-ed61d5a4dd94 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:04.543837 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7b2a518e-7b44-4b73-bfa3-4e9d1236137d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:04.544091 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-421dc19b-24f1-4f6e-bee1-e6b4624944df req-9ad49882-01bd-470d-b517-ed61d5a4dd94 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:04.544747 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7b2a518e-7b44-4b73-bfa3-4e9d1236137d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:04.556767 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-421dc19b-24f1-4f6e-bee1-e6b4624944df req-9ad49882-01bd-470d-b517-ed61d5a4dd94 service nova] Creating event network-changed:a4dcaec8-ba6f-42d9-859e-cf2a72be0b5d for instance 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c on hv-cinder-77398 Feb 21 04:30:04.563869 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-421dc19b-24f1-4f6e-bee1-e6b4624944df req-9ad49882-01bd-470d-b517-ed61d5a4dd94 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039373 Feb 21 04:30:04.564939 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 578/1160] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:30:04.570026 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7b2a518e-7b44-4b73-bfa3-4e9d1236137d tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/ips" status: 200 len: 105 microversion: 2.1 time: 0.048622 Feb 21 04:30:04.570775 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 583/1161] 10.222.0.10 () {58 vars in 1247 bytes} [Mon Feb 21 04:30:04 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/ips => generated 105 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:30:05.904693 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-abd4d328-9722-4875-b948-dcf7a72c002c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dff60ae-6a18-44cd-a71f-b456c3893eed"}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:30:05.905822 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-abd4d328-9722-4875-b948-dcf7a72c002c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:05.911802 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-abd4d328-9722-4875-b948-dcf7a72c002c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:05.912249 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-abd4d328-9722-4875-b948-dcf7a72c002c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:05.913108 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-abd4d328-9722-4875-b948-dcf7a72c002c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:05.913542 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-abd4d328-9722-4875-b948-dcf7a72c002c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:06.139320 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-abd4d328-9722-4875-b948-dcf7a72c002c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "POST /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239748 Feb 21 04:30:06.139940 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 579/1162] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:30:05 2022] POST /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:30:13.599037 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-97b64ccb-e84b-40e2-97c9-9e2ee5b71417 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:13.600003 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-97b64ccb-e84b-40e2-97c9-9e2ee5b71417 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:13.606442 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-97b64ccb-e84b-40e2-97c9-9e2ee5b71417 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:13.606892 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-97b64ccb-e84b-40e2-97c9-9e2ee5b71417 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:13.607679 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-97b64ccb-e84b-40e2-97c9-9e2ee5b71417 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:13.608111 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-97b64ccb-e84b-40e2-97c9-9e2ee5b71417 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:13.638695 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-97b64ccb-e84b-40e2-97c9-9e2ee5b71417 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Feb 21 04:30:13.639260 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 584/1163] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:30:13 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:30:13.649757 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-7213835c-2a3a-4a02-96db-7916685d16ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:13.650366 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-7213835c-2a3a-4a02-96db-7916685d16ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:13.656493 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7213835c-2a3a-4a02-96db-7916685d16ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:13.656996 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7213835c-2a3a-4a02-96db-7916685d16ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:13.657765 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7213835c-2a3a-4a02-96db-7916685d16ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:13.658196 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-7213835c-2a3a-4a02-96db-7916685d16ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:13.685965 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-7213835c-2a3a-4a02-96db-7916685d16ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments/6dff60ae-6a18-44cd-a71f-b456c3893eed" status: 200 len: 194 microversion: 2.1 time: 0.040649 Feb 21 04:30:13.686548 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 580/1164] 10.222.0.10 () {58 vars in 1412 bytes} [Mon Feb 21 04:30:13 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments/6dff60ae-6a18-44cd-a71f-b456c3893eed => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:30:13.759122 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d53746de-a46f-4b82-ab18-168917a0b7b5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:13.759997 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d53746de-a46f-4b82-ab18-168917a0b7b5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:13.770836 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d53746de-a46f-4b82-ab18-168917a0b7b5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:13.771282 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d53746de-a46f-4b82-ab18-168917a0b7b5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:13.772181 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d53746de-a46f-4b82-ab18-168917a0b7b5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:13.772617 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d53746de-a46f-4b82-ab18-168917a0b7b5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:13.802502 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d53746de-a46f-4b82-ab18-168917a0b7b5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Going to try to terminate instance {{(pid=116571) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:30:13.851873 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-b37a6540-4a1e-471a-a182-1b0ebe990634 req-abeab271-0d49-4361-aa15-8dd64e4a587a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183ac1ab-bbc7-45b8-854d-c2a58fa0efdb", "tag": "35b91d10-b47f-430e-984b-065790ea3b32"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:30:13.853637 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:30:13.853637 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:30:13.861091 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-b37a6540-4a1e-471a-a182-1b0ebe990634 req-abeab271-0d49-4361-aa15-8dd64e4a587a service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:13.861726 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-b37a6540-4a1e-471a-a182-1b0ebe990634 req-abeab271-0d49-4361-aa15-8dd64e4a587a service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:13.876702 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-b37a6540-4a1e-471a-a182-1b0ebe990634 req-abeab271-0d49-4361-aa15-8dd64e4a587a service nova] Creating event network-changed:35b91d10-b47f-430e-984b-065790ea3b32 for instance 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb on hv-cinder-77398 Feb 21 04:30:13.882936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-b37a6540-4a1e-471a-a182-1b0ebe990634 req-abeab271-0d49-4361-aa15-8dd64e4a587a service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116658 Feb 21 04:30:13.886042 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 581/1165] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:30:13.929279 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d53746de-a46f-4b82-ab18-168917a0b7b5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "DELETE /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 204 len: 0 microversion: 2.1 time: 0.174881 Feb 21 04:30:13.930306 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 585/1166] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:30:13 2022] DELETE /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:30:13.939725 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-ebc7d546-6d4b-424c-aa80-48c91c47788f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:13.940515 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-ebc7d546-6d4b-424c-aa80-48c91c47788f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:13.951863 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ebc7d546-6d4b-424c-aa80-48c91c47788f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:13.955021 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ebc7d546-6d4b-424c-aa80-48c91c47788f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:13.955886 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ebc7d546-6d4b-424c-aa80-48c91c47788f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:13.956340 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-ebc7d546-6d4b-424c-aa80-48c91c47788f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:14.119454 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-ebc7d546-6d4b-424c-aa80-48c91c47788f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:30:14.128940 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-ebc7d546-6d4b-424c-aa80-48c91c47788f tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1577 microversion: 2.1 time: 0.193481 Feb 21 04:30:14.129784 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 582/1167] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:30:13 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:30:15.042863 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-a8949d93-89b9-4013-9edf-c3030bfd1301 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ade46ff-f464-476a-97d4-d847d6506fae"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:30:15.044060 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-a8949d93-89b9-4013-9edf-c3030bfd1301 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:15.050294 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a8949d93-89b9-4013-9edf-c3030bfd1301 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:15.050742 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a8949d93-89b9-4013-9edf-c3030bfd1301 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:15.051513 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a8949d93-89b9-4013-9edf-c3030bfd1301 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:15.051947 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-a8949d93-89b9-4013-9edf-c3030bfd1301 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:15.146918 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-25f1f11a-2663-4d15-a94e-85a8c4e7cc38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:15.147532 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-25f1f11a-2663-4d15-a94e-85a8c4e7cc38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:15.154440 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-25f1f11a-2663-4d15-a94e-85a8c4e7cc38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:15.154898 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-25f1f11a-2663-4d15-a94e-85a8c4e7cc38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:15.155684 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-25f1f11a-2663-4d15-a94e-85a8c4e7cc38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:15.156112 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-25f1f11a-2663-4d15-a94e-85a8c4e7cc38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:15.292860 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-a8949d93-89b9-4013-9edf-c3030bfd1301 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "POST /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254526 Feb 21 04:30:15.298017 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 586/1168] 10.222.0.10 () {60 vars in 1322 bytes} [Mon Feb 21 04:30:15 2022] POST /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:30:15.305499 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-25f1f11a-2663-4d15-a94e-85a8c4e7cc38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:30:15.315111 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-25f1f11a-2663-4d15-a94e-85a8c4e7cc38 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1459 microversion: 2.1 time: 0.171653 Feb 21 04:30:15.315742 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 583/1169] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:30:15 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1459 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:30:16.269523 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-867a2d79-1530-43bb-9956-f0ac7a8cfb49 req-08f3c8f0-9ca9-400e-bd4e-ba31096eab5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183ac1ab-bbc7-45b8-854d-c2a58fa0efdb", "name": "network-vif-deleted", "tag": "35b91d10-b47f-430e-984b-065790ea3b32"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:30:16.271190 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:30:16.271190 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:30:16.282931 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-867a2d79-1530-43bb-9956-f0ac7a8cfb49 req-08f3c8f0-9ca9-400e-bd4e-ba31096eab5f service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:16.283684 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-867a2d79-1530-43bb-9956-f0ac7a8cfb49 req-08f3c8f0-9ca9-400e-bd4e-ba31096eab5f service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:16.295889 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-867a2d79-1530-43bb-9956-f0ac7a8cfb49 req-08f3c8f0-9ca9-400e-bd4e-ba31096eab5f service nova] Creating event network-vif-deleted:35b91d10-b47f-430e-984b-065790ea3b32 for instance 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb on hv-cinder-77398 Feb 21 04:30:16.300532 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-867a2d79-1530-43bb-9956-f0ac7a8cfb49 req-08f3c8f0-9ca9-400e-bd4e-ba31096eab5f service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035631 Feb 21 04:30:16.301152 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 587/1170] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:30:16.332440 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-376673e0-6a37-47d5-83f6-7fa56aa7c56a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:16.333071 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-376673e0-6a37-47d5-83f6-7fa56aa7c56a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:16.339914 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-376673e0-6a37-47d5-83f6-7fa56aa7c56a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:16.340549 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-376673e0-6a37-47d5-83f6-7fa56aa7c56a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:16.341543 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-376673e0-6a37-47d5-83f6-7fa56aa7c56a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:16.342076 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-376673e0-6a37-47d5-83f6-7fa56aa7c56a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:16.403333 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-376673e0-6a37-47d5-83f6-7fa56aa7c56a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:30:16.410622 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-376673e0-6a37-47d5-83f6-7fa56aa7c56a tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 200 len: 1224 microversion: 2.1 time: 0.081775 Feb 21 04:30:16.411170 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 584/1171] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:30:16 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:30:17.428053 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7ec633ed-82c6-4884-b3ff-38877fd4b2e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:17.428783 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7ec633ed-82c6-4884-b3ff-38877fd4b2e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:17.434795 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ec633ed-82c6-4884-b3ff-38877fd4b2e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:17.435248 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ec633ed-82c6-4884-b3ff-38877fd4b2e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:17.436034 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ec633ed-82c6-4884-b3ff-38877fd4b2e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:17.436469 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7ec633ed-82c6-4884-b3ff-38877fd4b2e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:17.449323 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-7ec633ed-82c6-4884-b3ff-38877fd4b2e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] HTTP exception thrown: Instance 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb could not be found. Feb 21 04:30:17.449912 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7ec633ed-82c6-4884-b3ff-38877fd4b2e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Returning 404 to user: Instance 183ac1ab-bbc7-45b8-854d-c2a58fa0efdb could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:30:17.450768 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7ec633ed-82c6-4884-b3ff-38877fd4b2e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb" status: 404 len: 111 microversion: 2.1 time: 0.027131 Feb 21 04:30:17.451295 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 588/1172] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:30:17 2022] GET /compute/v2.1/servers/183ac1ab-bbc7-45b8-854d-c2a58fa0efdb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:30:20.511554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6ef3b2e8-19a0-4582-ad8c-49ac7396487c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:20.512207 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6ef3b2e8-19a0-4582-ad8c-49ac7396487c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:20.514244 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-12d3b22c-871b-44b4-b931-31522956a99e req-c9383e14-88ba-4844-90d6-0d42d72e9115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f0d468e-1c55-4684-8d83-192d0f7cfd9f", "tag": "dfe64259-0c81-4f8f-8deb-f058279bb2fc"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:30:20.515828 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:30:20.515828 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:30:20.520020 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6ef3b2e8-19a0-4582-ad8c-49ac7396487c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:20.520466 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6ef3b2e8-19a0-4582-ad8c-49ac7396487c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:20.521268 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6ef3b2e8-19a0-4582-ad8c-49ac7396487c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:20.521696 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6ef3b2e8-19a0-4582-ad8c-49ac7396487c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:20.523678 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-12d3b22c-871b-44b4-b931-31522956a99e req-c9383e14-88ba-4844-90d6-0d42d72e9115 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:20.524123 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-12d3b22c-871b-44b4-b931-31522956a99e req-c9383e14-88ba-4844-90d6-0d42d72e9115 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:20.536288 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-12d3b22c-871b-44b4-b931-31522956a99e req-c9383e14-88ba-4844-90d6-0d42d72e9115 service nova] Creating event network-changed:dfe64259-0c81-4f8f-8deb-f058279bb2fc for instance 1f0d468e-1c55-4684-8d83-192d0f7cfd9f on hv-cinder-77398 Feb 21 04:30:20.541533 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-12d3b22c-871b-44b4-b931-31522956a99e req-c9383e14-88ba-4844-90d6-0d42d72e9115 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031975 Feb 21 04:30:20.542127 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 589/1173] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:30:20.549118 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6ef3b2e8-19a0-4582-ad8c-49ac7396487c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Going to try to terminate instance {{(pid=116570) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:30:20.651748 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6ef3b2e8-19a0-4582-ad8c-49ac7396487c tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "DELETE /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 204 len: 0 microversion: 2.1 time: 0.143091 Feb 21 04:30:20.656031 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 585/1174] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:30:20 2022] DELETE /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:30:20.661644 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-346d69b4-6b3f-4ed3-8011-ab169ce41429 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:20.662352 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-346d69b4-6b3f-4ed3-8011-ab169ce41429 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:20.670871 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-346d69b4-6b3f-4ed3-8011-ab169ce41429 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:20.671327 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-346d69b4-6b3f-4ed3-8011-ab169ce41429 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:20.672128 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-346d69b4-6b3f-4ed3-8011-ab169ce41429 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:20.672564 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-346d69b4-6b3f-4ed3-8011-ab169ce41429 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:20.834400 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-346d69b4-6b3f-4ed3-8011-ab169ce41429 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:30:20.842362 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-346d69b4-6b3f-4ed3-8011-ab169ce41429 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1580 microversion: 2.1 time: 0.184745 Feb 21 04:30:20.843173 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 590/1175] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:30:20 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1580 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:30:21.859686 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-79387e4c-9473-4fef-82ca-e91e2e1c8ea6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:21.860425 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-79387e4c-9473-4fef-82ca-e91e2e1c8ea6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:21.866982 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-79387e4c-9473-4fef-82ca-e91e2e1c8ea6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:21.867428 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-79387e4c-9473-4fef-82ca-e91e2e1c8ea6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:21.868202 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-79387e4c-9473-4fef-82ca-e91e2e1c8ea6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:21.868658 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-79387e4c-9473-4fef-82ca-e91e2e1c8ea6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:22.005852 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-79387e4c-9473-4fef-82ca-e91e2e1c8ea6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:30:22.013782 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-79387e4c-9473-4fef-82ca-e91e2e1c8ea6 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1461 microversion: 2.1 time: 0.158137 Feb 21 04:30:22.014348 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 586/1176] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:30:21 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1461 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:30:22.872189 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-0b537bfc-b1ab-4fc4-a364-a5f2934e5fe3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:22.873183 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-0b537bfc-b1ab-4fc4-a364-a5f2934e5fe3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:22.879602 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0b537bfc-b1ab-4fc4-a364-a5f2934e5fe3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:22.880049 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0b537bfc-b1ab-4fc4-a364-a5f2934e5fe3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:22.880917 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0b537bfc-b1ab-4fc4-a364-a5f2934e5fe3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:22.881350 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-0b537bfc-b1ab-4fc4-a364-a5f2934e5fe3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:22.911772 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-0b537bfc-b1ab-4fc4-a364-a5f2934e5fe3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043294 Feb 21 04:30:22.912327 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 591/1177] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:30:22 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:30:23.031558 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-bd9db2bf-7618-4968-9fde-898c5b996822 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:23.032274 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-bd9db2bf-7618-4968-9fde-898c5b996822 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:23.038603 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bd9db2bf-7618-4968-9fde-898c5b996822 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:23.039119 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bd9db2bf-7618-4968-9fde-898c5b996822 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:23.039957 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bd9db2bf-7618-4968-9fde-898c5b996822 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:23.040450 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bd9db2bf-7618-4968-9fde-898c5b996822 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:23.175800 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-bd9db2bf-7618-4968-9fde-898c5b996822 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d93b90b374dd49ad9649be92b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e5cd46d4684e9e9de6e634cfa13b5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:30:23.186035 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-bd9db2bf-7618-4968-9fde-898c5b996822 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 200 len: 1461 microversion: 2.1 time: 0.158230 Feb 21 04:30:23.195671 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 587/1178] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:30:23 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 1461 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:30:23.242139 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-ebccebb8-1690-4e72-9db0-aa1cbb9c3b90 req-84fc9f32-1c3d-4a45-878a-4ae5356d91e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f0d468e-1c55-4684-8d83-192d0f7cfd9f", "name": "network-vif-deleted", "tag": "dfe64259-0c81-4f8f-8deb-f058279bb2fc"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:30:23.243834 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:30:23.243834 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:30:23.252077 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-ebccebb8-1690-4e72-9db0-aa1cbb9c3b90 req-84fc9f32-1c3d-4a45-878a-4ae5356d91e3 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:23.252615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-ebccebb8-1690-4e72-9db0-aa1cbb9c3b90 req-84fc9f32-1c3d-4a45-878a-4ae5356d91e3 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:23.265060 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-ebccebb8-1690-4e72-9db0-aa1cbb9c3b90 req-84fc9f32-1c3d-4a45-878a-4ae5356d91e3 service nova] Creating event network-vif-deleted:dfe64259-0c81-4f8f-8deb-f058279bb2fc for instance 1f0d468e-1c55-4684-8d83-192d0f7cfd9f on hv-cinder-77398 Feb 21 04:30:23.270883 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-ebccebb8-1690-4e72-9db0-aa1cbb9c3b90 req-84fc9f32-1c3d-4a45-878a-4ae5356d91e3 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032357 Feb 21 04:30:23.271649 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 592/1179] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:30:24.202729 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-10b7d355-2256-4b5e-87dc-6c294e9788e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:24.203330 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-10b7d355-2256-4b5e-87dc-6c294e9788e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 1f0d468e-1c55-4684-8d83-192d0f7cfd9f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:24.209567 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-10b7d355-2256-4b5e-87dc-6c294e9788e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:24.210014 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-10b7d355-2256-4b5e-87dc-6c294e9788e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:24.210782 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-10b7d355-2256-4b5e-87dc-6c294e9788e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:24.211224 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-10b7d355-2256-4b5e-87dc-6c294e9788e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:24.224285 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-10b7d355-2256-4b5e-87dc-6c294e9788e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] HTTP exception thrown: Instance 1f0d468e-1c55-4684-8d83-192d0f7cfd9f could not be found. Feb 21 04:30:24.224883 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-10b7d355-2256-4b5e-87dc-6c294e9788e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Returning 404 to user: Instance 1f0d468e-1c55-4684-8d83-192d0f7cfd9f could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:30:24.225691 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-10b7d355-2256-4b5e-87dc-6c294e9788e5 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f" status: 404 len: 111 microversion: 2.1 time: 0.026683 Feb 21 04:30:24.226203 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 588/1180] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:30:24 2022] GET /compute/v2.1/servers/1f0d468e-1c55-4684-8d83-192d0f7cfd9f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:30:24.666022 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5ac0439b-c2af-4741-8982-9b7278112b30 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:24.666617 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5ac0439b-c2af-4741-8982-9b7278112b30 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:24.673319 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5ac0439b-c2af-4741-8982-9b7278112b30 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:24.673771 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5ac0439b-c2af-4741-8982-9b7278112b30 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:24.674546 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5ac0439b-c2af-4741-8982-9b7278112b30 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:24.675010 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5ac0439b-c2af-4741-8982-9b7278112b30 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:24.688558 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-5ac0439b-c2af-4741-8982-9b7278112b30 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] HTTP exception thrown: Instance 5de498f5-d90a-4864-a2fd-8c7634d9b07a could not be found. Feb 21 04:30:24.689169 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5ac0439b-c2af-4741-8982-9b7278112b30 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Returning 404 to user: Instance 5de498f5-d90a-4864-a2fd-8c7634d9b07a could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:30:24.690069 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5ac0439b-c2af-4741-8982-9b7278112b30 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "DELETE /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 404 len: 111 microversion: 2.1 time: 0.028071 Feb 21 04:30:24.690655 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 593/1181] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:30:24 2022] DELETE /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:30:24.699184 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e6c4e367-1ba1-455d-9e3c-e33f3d77215d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:24.699800 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e6c4e367-1ba1-455d-9e3c-e33f3d77215d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] [instance: 5de498f5-d90a-4864-a2fd-8c7634d9b07a] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:30:24.705555 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6c4e367-1ba1-455d-9e3c-e33f3d77215d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:24.705999 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6c4e367-1ba1-455d-9e3c-e33f3d77215d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:24.706767 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6c4e367-1ba1-455d-9e3c-e33f3d77215d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:30:24.707199 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e6c4e367-1ba1-455d-9e3c-e33f3d77215d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:30:24.719899 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-e6c4e367-1ba1-455d-9e3c-e33f3d77215d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] HTTP exception thrown: Instance 5de498f5-d90a-4864-a2fd-8c7634d9b07a could not be found. Feb 21 04:30:24.720466 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e6c4e367-1ba1-455d-9e3c-e33f3d77215d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Returning 404 to user: Instance 5de498f5-d90a-4864-a2fd-8c7634d9b07a could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:30:24.721340 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e6c4e367-1ba1-455d-9e3c-e33f3d77215d tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a" status: 404 len: 111 microversion: 2.1 time: 0.026500 Feb 21 04:30:24.721845 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 589/1182] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:30:24 2022] GET /compute/v2.1/servers/5de498f5-d90a-4864-a2fd-8c7634d9b07a => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:30:26.004172 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f8aa3195-0c4a-43e6-b646-3d55676fc019 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] Calling method '.version_select at 0x7feee0e88310>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:30:26.029500 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f8aa3195-0c4a-43e6-b646-3d55676fc019 tempest-TestVolumeBootPattern-1816334580 tempest-TestVolumeBootPattern-1816334580-project] 10.222.0.10 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2040225681" status: 202 len: 0 microversion: 2.1 time: 0.029266 Feb 21 04:30:26.030100 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 594/1183] 10.222.0.10 () {58 vars in 1262 bytes} [Mon Feb 21 04:30:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2040225681 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:30:47.633575 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:30:47.633575 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: Mon Feb 21 04:30:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:31:11.033766 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-3081344e-d5f0-40e0-9c83-e2cd15dc5c84 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:11.034431 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-3081344e-d5f0-40e0-9c83-e2cd15dc5c84 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:11.040360 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3081344e-d5f0-40e0-9c83-e2cd15dc5c84 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:11.040851 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3081344e-d5f0-40e0-9c83-e2cd15dc5c84 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:11.041642 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3081344e-d5f0-40e0-9c83-e2cd15dc5c84 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:11.042087 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-3081344e-d5f0-40e0-9c83-e2cd15dc5c84 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:11.069782 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-3081344e-d5f0-40e0-9c83-e2cd15dc5c84 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments/6dff60ae-6a18-44cd-a71f-b456c3893eed" status: 200 len: 194 microversion: 2.1 time: 0.039834 Feb 21 04:31:11.070352 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 590/1184] 10.222.0.10 () {58 vars in 1412 bytes} [Mon Feb 21 04:31:11 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments/6dff60ae-6a18-44cd-a71f-b456c3893eed => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:31:11.080576 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d3a5a551-059f-4e90-ac5f-182ffbdb969f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:11.081096 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d3a5a551-059f-4e90-ac5f-182ffbdb969f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:11.088212 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d3a5a551-059f-4e90-ac5f-182ffbdb969f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:11.088687 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d3a5a551-059f-4e90-ac5f-182ffbdb969f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:11.089474 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d3a5a551-059f-4e90-ac5f-182ffbdb969f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:11.089915 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d3a5a551-059f-4e90-ac5f-182ffbdb969f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:11.164059 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-d3a5a551-059f-4e90-ac5f-182ffbdb969f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lazy-loading 'services' on Instance uuid 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:31:11.230862 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d3a5a551-059f-4e90-ac5f-182ffbdb969f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "DELETE /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments/6dff60ae-6a18-44cd-a71f-b456c3893eed" status: 202 len: 0 microversion: 2.1 time: 0.154374 Feb 21 04:31:11.231470 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 595/1185] 10.222.0.10 () {58 vars in 1415 bytes} [Mon Feb 21 04:31:11 2022] DELETE /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments/6dff60ae-6a18-44cd-a71f-b456c3893eed => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:31:12.336294 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-844a53ca-97ab-499f-ae8c-2c90179f86ad tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:12.336819 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-844a53ca-97ab-499f-ae8c-2c90179f86ad tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:12.343567 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-844a53ca-97ab-499f-ae8c-2c90179f86ad tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:12.344211 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-844a53ca-97ab-499f-ae8c-2c90179f86ad tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:12.345241 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-844a53ca-97ab-499f-ae8c-2c90179f86ad tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:12.345787 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-844a53ca-97ab-499f-ae8c-2c90179f86ad tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:12.373378 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-844a53ca-97ab-499f-ae8c-2c90179f86ad tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments/8ade46ff-f464-476a-97d4-d847d6506fae" status: 200 len: 194 microversion: 2.1 time: 0.040649 Feb 21 04:31:12.374051 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 591/1186] 10.222.0.10 () {58 vars in 1412 bytes} [Mon Feb 21 04:31:12 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments/8ade46ff-f464-476a-97d4-d847d6506fae => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:31:12.384954 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8f07fa37-0cd6-41c1-918a-14036ac7b350 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:12.385535 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-8f07fa37-0cd6-41c1-918a-14036ac7b350 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:12.391518 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8f07fa37-0cd6-41c1-918a-14036ac7b350 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:12.391967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8f07fa37-0cd6-41c1-918a-14036ac7b350 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:12.392777 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8f07fa37-0cd6-41c1-918a-14036ac7b350 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:12.393231 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8f07fa37-0cd6-41c1-918a-14036ac7b350 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:12.468805 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.objects.instance [None req-8f07fa37-0cd6-41c1-918a-14036ac7b350 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lazy-loading 'services' on Instance uuid 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c {{(pid=116571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:31:12.536068 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-8f07fa37-0cd6-41c1-918a-14036ac7b350 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "DELETE /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments/8ade46ff-f464-476a-97d4-d847d6506fae" status: 202 len: 0 microversion: 2.1 time: 0.156033 Feb 21 04:31:12.536654 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 596/1187] 10.222.0.10 () {58 vars in 1415 bytes} [Mon Feb 21 04:31:12 2022] DELETE /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments/8ade46ff-f464-476a-97d4-d847d6506fae => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:31:13.687266 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-2fbd1b86-3a4d-49c8-a7c2-d4dd7d93c6f7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:13.688225 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-2fbd1b86-3a4d-49c8-a7c2-d4dd7d93c6f7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:13.694384 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2fbd1b86-3a4d-49c8-a7c2-d4dd7d93c6f7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:13.694835 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2fbd1b86-3a4d-49c8-a7c2-d4dd7d93c6f7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:13.695596 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2fbd1b86-3a4d-49c8-a7c2-d4dd7d93c6f7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:13.696025 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-2fbd1b86-3a4d-49c8-a7c2-d4dd7d93c6f7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:13.724904 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-2fbd1b86-3a4d-49c8-a7c2-d4dd7d93c6f7 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041257 Feb 21 04:31:13.725434 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 592/1188] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:31:13 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 04:31:13.824305 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-2fac0cd2-5d9c-4f26-aa91-28e89c06f0c2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:13.825657 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-2fac0cd2-5d9c-4f26-aa91-28e89c06f0c2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:13.833739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2fac0cd2-5d9c-4f26-aa91-28e89c06f0c2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:13.834212 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2fac0cd2-5d9c-4f26-aa91-28e89c06f0c2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:13.835007 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2fac0cd2-5d9c-4f26-aa91-28e89c06f0c2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:13.835451 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-2fac0cd2-5d9c-4f26-aa91-28e89c06f0c2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:13.865253 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-2fac0cd2-5d9c-4f26-aa91-28e89c06f0c2 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045808 Feb 21 04:31:13.865734 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 597/1189] 10.222.0.10 () {58 vars in 1301 bytes} [Mon Feb 21 04:31:13 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 04:31:13.919497 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-410044e8-7836-418e-a1b7-e8c7da2763ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:13.920016 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-410044e8-7836-418e-a1b7-e8c7da2763ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:13.925700 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-410044e8-7836-418e-a1b7-e8c7da2763ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:13.926149 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-410044e8-7836-418e-a1b7-e8c7da2763ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:13.926920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-410044e8-7836-418e-a1b7-e8c7da2763ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:13.927354 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-410044e8-7836-418e-a1b7-e8c7da2763ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:13.950907 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-410044e8-7836-418e-a1b7-e8c7da2763ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Going to try to terminate instance {{(pid=116570) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:31:14.020578 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-410044e8-7836-418e-a1b7-e8c7da2763ec tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "DELETE /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 204 len: 0 microversion: 2.1 time: 0.104546 Feb 21 04:31:14.021227 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 593/1190] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:31:13 2022] DELETE /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:31:14.031044 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-7f885164-238b-45b5-a043-ebb5b0c4c99c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:14.031664 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-7f885164-238b-45b5-a043-ebb5b0c4c99c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:14.037468 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7f885164-238b-45b5-a043-ebb5b0c4c99c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:14.037925 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7f885164-238b-45b5-a043-ebb5b0c4c99c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:14.038704 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7f885164-238b-45b5-a043-ebb5b0c4c99c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:14.039141 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-7f885164-238b-45b5-a043-ebb5b0c4c99c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:14.179122 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-7f885164-238b-45b5-a043-ebb5b0c4c99c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:31:14.186920 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-7f885164-238b-45b5-a043-ebb5b0c4c99c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1673 microversion: 2.1 time: 0.160257 Feb 21 04:31:14.187479 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 598/1191] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:31:14 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:31:15.204859 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-32293107-dc55-474f-9958-a157fd32f81f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:15.205554 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-32293107-dc55-474f-9958-a157fd32f81f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:15.211697 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-32293107-dc55-474f-9958-a157fd32f81f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:15.212649 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-32293107-dc55-474f-9958-a157fd32f81f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:15.213423 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-32293107-dc55-474f-9958-a157fd32f81f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:15.213849 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-32293107-dc55-474f-9958-a157fd32f81f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:15.345213 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-32293107-dc55-474f-9958-a157fd32f81f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:31:15.352724 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-32293107-dc55-474f-9958-a157fd32f81f tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1673 microversion: 2.1 time: 0.151866 Feb 21 04:31:15.353285 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 594/1192] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:31:15 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:31:16.370136 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9ee8f99a-4796-4d53-8a37-3b0301e3be7e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:16.370742 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9ee8f99a-4796-4d53-8a37-3b0301e3be7e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:16.376610 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9ee8f99a-4796-4d53-8a37-3b0301e3be7e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:16.377111 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9ee8f99a-4796-4d53-8a37-3b0301e3be7e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:16.377870 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9ee8f99a-4796-4d53-8a37-3b0301e3be7e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:16.378300 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9ee8f99a-4796-4d53-8a37-3b0301e3be7e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:16.517223 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9ee8f99a-4796-4d53-8a37-3b0301e3be7e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd165f2d03fdd43069795313e84816e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95f468f72044118862b24027a3667e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:31:16.525131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9ee8f99a-4796-4d53-8a37-3b0301e3be7e tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 200 len: 1673 microversion: 2.1 time: 0.158708 Feb 21 04:31:16.526131 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 599/1193] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:31:16 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:31:16.913085 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-d273c3ed-2858-4d1f-b53f-301e2a023839 req-15576ed0-6d24-4ba0-b0be-f1f7f2cda56e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5988e9b3-4462-49f4-9bbc-bab50ecf0d9c", "name": "network-vif-deleted", "tag": "a4dcaec8-ba6f-42d9-859e-cf2a72be0b5d"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:31:16.915483 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:31:16.915483 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:31:16.925694 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-d273c3ed-2858-4d1f-b53f-301e2a023839 req-15576ed0-6d24-4ba0-b0be-f1f7f2cda56e service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:16.926256 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-d273c3ed-2858-4d1f-b53f-301e2a023839 req-15576ed0-6d24-4ba0-b0be-f1f7f2cda56e service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:16.940684 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-d273c3ed-2858-4d1f-b53f-301e2a023839 req-15576ed0-6d24-4ba0-b0be-f1f7f2cda56e service nova] Creating event network-vif-deleted:a4dcaec8-ba6f-42d9-859e-cf2a72be0b5d for instance 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c on hv-cinder-77398 Feb 21 04:31:16.947444 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-d273c3ed-2858-4d1f-b53f-301e2a023839 req-15576ed0-6d24-4ba0-b0be-f1f7f2cda56e service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037536 Feb 21 04:31:16.948565 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 595/1194] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:31:17.543597 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8445fd55-c1b1-45b9-b3a4-e01cb6360586 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:17.544319 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-8445fd55-c1b1-45b9-b3a4-e01cb6360586 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:17.550773 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8445fd55-c1b1-45b9-b3a4-e01cb6360586 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:17.551229 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8445fd55-c1b1-45b9-b3a4-e01cb6360586 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:17.552006 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8445fd55-c1b1-45b9-b3a4-e01cb6360586 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:17.552441 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8445fd55-c1b1-45b9-b3a4-e01cb6360586 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:17.566077 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-8445fd55-c1b1-45b9-b3a4-e01cb6360586 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] HTTP exception thrown: Instance 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c could not be found. Feb 21 04:31:17.566668 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8445fd55-c1b1-45b9-b3a4-e01cb6360586 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Returning 404 to user: Instance 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:31:17.567543 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-8445fd55-c1b1-45b9-b3a4-e01cb6360586 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 404 len: 111 microversion: 2.1 time: 0.028310 Feb 21 04:31:17.568100 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 600/1195] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:31:17 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:31:17.576849 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5bd27456-b5db-491e-9576-886a6f828fd6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '.version_select at 0x7feee145b430>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:17.594975 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5bd27456-b5db-491e-9576-886a6f828fd6 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361640865" status: 202 len: 0 microversion: 2.1 time: 0.021868 Feb 21 04:31:17.595297 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 596/1196] 10.222.0.10 () {58 vars in 1220 bytes} [Mon Feb 21 04:31:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361640865 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 04:31:20.689118 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4d7ab01e-4681-4e67-9c09-af3af1d0efd3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:20.689639 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4d7ab01e-4681-4e67-9c09-af3af1d0efd3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:20.695817 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4d7ab01e-4681-4e67-9c09-af3af1d0efd3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:20.696314 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4d7ab01e-4681-4e67-9c09-af3af1d0efd3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:20.697111 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4d7ab01e-4681-4e67-9c09-af3af1d0efd3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:20.697538 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4d7ab01e-4681-4e67-9c09-af3af1d0efd3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:20.710151 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-4d7ab01e-4681-4e67-9c09-af3af1d0efd3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] HTTP exception thrown: Instance 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c could not be found. Feb 21 04:31:20.710721 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4d7ab01e-4681-4e67-9c09-af3af1d0efd3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Returning 404 to user: Instance 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:31:20.711512 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4d7ab01e-4681-4e67-9c09-af3af1d0efd3 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "DELETE /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 404 len: 111 microversion: 2.1 time: 0.026079 Feb 21 04:31:20.712013 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 601/1197] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:31:20 2022] DELETE /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:31:20.720093 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4b427599-40c5-48ef-a4dc-2dafb34b815c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:20.720852 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-4b427599-40c5-48ef-a4dc-2dafb34b815c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:20.726781 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4b427599-40c5-48ef-a4dc-2dafb34b815c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:20.727727 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4b427599-40c5-48ef-a4dc-2dafb34b815c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:20.728505 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4b427599-40c5-48ef-a4dc-2dafb34b815c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:20.728964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-4b427599-40c5-48ef-a4dc-2dafb34b815c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:20.741657 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-4b427599-40c5-48ef-a4dc-2dafb34b815c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] HTTP exception thrown: Instance 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c could not be found. Feb 21 04:31:20.742238 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-4b427599-40c5-48ef-a4dc-2dafb34b815c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Returning 404 to user: Instance 5988e9b3-4462-49f4-9bbc-bab50ecf0d9c could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:31:20.743697 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-4b427599-40c5-48ef-a4dc-2dafb34b815c tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c" status: 404 len: 111 microversion: 2.1 time: 0.027129 Feb 21 04:31:20.744228 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 597/1198] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:31:20 2022] GET /compute/v2.1/servers/5988e9b3-4462-49f4-9bbc-bab50ecf0d9c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:31:21.868732 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d181d591-9297-4965-af77-d5a168488dc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:21.869213 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-d181d591-9297-4965-af77-d5a168488dc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:21.875354 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d181d591-9297-4965-af77-d5a168488dc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:21.875801 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d181d591-9297-4965-af77-d5a168488dc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:21.876563 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d181d591-9297-4965-af77-d5a168488dc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:21.877019 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-d181d591-9297-4965-af77-d5a168488dc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:21.890383 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-d181d591-9297-4965-af77-d5a168488dc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] HTTP exception thrown: Instance 93b3eafa-8661-45e6-a0ae-920c3499ae2f could not be found. Feb 21 04:31:21.890947 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-d181d591-9297-4965-af77-d5a168488dc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Returning 404 to user: Instance 93b3eafa-8661-45e6-a0ae-920c3499ae2f could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:31:21.891741 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-d181d591-9297-4965-af77-d5a168488dc5 tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "DELETE /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 404 len: 111 microversion: 2.1 time: 0.027178 Feb 21 04:31:21.892246 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 602/1199] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:31:21 2022] DELETE /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:31:21.899644 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b0e66467-c381-4354-99c3-cd67174a46eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:31:21.900255 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b0e66467-c381-4354-99c3-cd67174a46eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] [instance: 93b3eafa-8661-45e6-a0ae-920c3499ae2f] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:31:21.906712 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b0e66467-c381-4354-99c3-cd67174a46eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:21.907161 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b0e66467-c381-4354-99c3-cd67174a46eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:21.907936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b0e66467-c381-4354-99c3-cd67174a46eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:31:21.908369 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b0e66467-c381-4354-99c3-cd67174a46eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:31:21.921049 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.wsgi [None req-b0e66467-c381-4354-99c3-cd67174a46eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] HTTP exception thrown: Instance 93b3eafa-8661-45e6-a0ae-920c3499ae2f could not be found. Feb 21 04:31:21.921618 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b0e66467-c381-4354-99c3-cd67174a46eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] Returning 404 to user: Instance 93b3eafa-8661-45e6-a0ae-920c3499ae2f could not be found. {{(pid=116570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:31:21.922419 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b0e66467-c381-4354-99c3-cd67174a46eb tempest-AttachVolumeTestJSON-208307241 tempest-AttachVolumeTestJSON-208307241-project] 10.222.0.10 "GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f" status: 404 len: 111 microversion: 2.1 time: 0.026436 Feb 21 04:31:21.922926 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 598/1200] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:31:21 2022] GET /compute/v2.1/servers/93b3eafa-8661-45e6-a0ae-920c3499ae2f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:31:53.901013 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-231471b9-4a0b-4ee6-afcd-79aeefd10e40 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Action: 'create', calling method: .version_select at 0x7feee58e1f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-2144632072"}} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:31:53.917095 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-231471b9-4a0b-4ee6-afcd-79aeefd10e40 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Getting quotas for project 00abea86acb349fab42fee7d8bdb778c. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:31:53.920998 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-231471b9-4a0b-4ee6-afcd-79aeefd10e40 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Getting quotas for user f24dfa9362e44c9cad1a8b20485b0a51 and project 00abea86acb349fab42fee7d8bdb778c. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:31:54.230828 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-231471b9-4a0b-4ee6-afcd-79aeefd10e40 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Getting quotas for project 00abea86acb349fab42fee7d8bdb778c. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:31:54.234668 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.quota [None req-231471b9-4a0b-4ee6-afcd-79aeefd10e40 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Getting quotas for user f24dfa9362e44c9cad1a8b20485b0a51 and project 00abea86acb349fab42fee7d8bdb778c. Resources: {'key_pairs'} {{(pid=116571) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:31:54.248563 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-231471b9-4a0b-4ee6-afcd-79aeefd10e40 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.513700 Feb 21 04:31:54.249392 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 603/1201] 10.222.0.10 () {60 vars in 1157 bytes} [Mon Feb 21 04:31:53 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:14.467920 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-645180923", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2144632072", "security_groups": [{"name": "tempest-secgroup-smoke-1413684360"}], "networks": [{"uuid": "5df0b645-a979-4dc1-8755-cee9cf249ec6"}], "block_device_mapping_v2": [{"uuid": "2f073db4-54ff-416d-bd03-c6f59aa6ab8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:32:14.573974 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.network.neutron [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] validate_networks() for [('5df0b645-a979-4dc1-8755-cee9cf249ec6', None, None, None, None, None)] {{(pid=116570) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 04:32:15.019296 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Flavor limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 04:32:15.019718 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Image limits 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 04:32:15.020184 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Flavor pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 04:32:15.020594 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Image pref 0:0:0 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 04:32:15.021025 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.virt.hardware [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 04:32:15.030152 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:15.030590 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:15.031391 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:15.031817 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:15.047923 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Getting quotas for project 00abea86acb349fab42fee7d8bdb778c. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 04:32:15.051748 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.quota [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Getting quotas for user f24dfa9362e44c9cad1a8b20485b0a51 and project 00abea86acb349fab42fee7d8bdb778c. Resources: {'instances', 'cores', 'ram'} {{(pid=116570) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 04:32:15.105076 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Going to run 1 instances... {{(pid=116570) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 04:32:15.107152 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2f073db4-54ff-416d-bd03-c6f59aa6ab8c',volume_size=None,volume_type=None)] {{(pid=116570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 04:32:15.224374 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b8caf7ac-7583-4587-bbd9-b1aa879d24c7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760220 Feb 21 04:32:15.225039 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 599/1202] 10.222.0.10 () {60 vars in 1146 bytes} [Mon Feb 21 04:32:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 04:32:15.237972 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4f117de6-b4a0-4569-9fc2-6e81bf7bd7c4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:15.239000 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4f117de6-b4a0-4569-9fc2-6e81bf7bd7c4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:15.302026 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4f117de6-b4a0-4569-9fc2-6e81bf7bd7c4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:15.309545 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4f117de6-b4a0-4569-9fc2-6e81bf7bd7c4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1088 microversion: 2.1 time: 0.077608 Feb 21 04:32:15.310112 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 604/1203] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:15 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:16.326800 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-972fb29d-ed51-4d45-8b90-11e5590649fa tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:16.327507 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-972fb29d-ed51-4d45-8b90-11e5590649fa tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:16.334362 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-972fb29d-ed51-4d45-8b90-11e5590649fa tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:16.335045 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-972fb29d-ed51-4d45-8b90-11e5590649fa tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:16.335832 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-972fb29d-ed51-4d45-8b90-11e5590649fa tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:16.336262 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-972fb29d-ed51-4d45-8b90-11e5590649fa tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:16.397780 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-972fb29d-ed51-4d45-8b90-11e5590649fa tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:16.405976 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-972fb29d-ed51-4d45-8b90-11e5590649fa tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1204 microversion: 2.1 time: 0.083487 Feb 21 04:32:16.406535 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 600/1204] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:16 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1204 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:17.422926 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-9022a598-f968-4909-9d97-e8b6fbad0056 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:17.423520 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-9022a598-f968-4909-9d97-e8b6fbad0056 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:17.429802 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9022a598-f968-4909-9d97-e8b6fbad0056 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:17.430250 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9022a598-f968-4909-9d97-e8b6fbad0056 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:17.431034 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9022a598-f968-4909-9d97-e8b6fbad0056 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:17.432082 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-9022a598-f968-4909-9d97-e8b6fbad0056 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:17.528403 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-c6dd6585-a985-452a-937f-b78201a988ad req-b12565be-462e-400b-969e-5d59575b57ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46cff89b-5103-458a-ad33-c4ecd25951ed", "tag": "6da3c99a-b3e2-431b-a334-fcde298d398a"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:32:17.530358 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:32:17.530358 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:32:17.547903 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-c6dd6585-a985-452a-937f-b78201a988ad req-b12565be-462e-400b-969e-5d59575b57ef service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:17.548394 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-c6dd6585-a985-452a-937f-b78201a988ad req-b12565be-462e-400b-969e-5d59575b57ef service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:17.560772 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-c6dd6585-a985-452a-937f-b78201a988ad req-b12565be-462e-400b-969e-5d59575b57ef service nova] Creating event network-changed:6da3c99a-b3e2-431b-a334-fcde298d398a for instance 46cff89b-5103-458a-ad33-c4ecd25951ed on hv-cinder-77398 Feb 21 04:32:17.566471 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-c6dd6585-a985-452a-937f-b78201a988ad req-b12565be-462e-400b-969e-5d59575b57ef service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042004 Feb 21 04:32:17.567584 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 601/1205] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:32:17.599277 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-9022a598-f968-4909-9d97-e8b6fbad0056 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:17.608978 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-9022a598-f968-4909-9d97-e8b6fbad0056 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1260 microversion: 2.1 time: 0.189632 Feb 21 04:32:17.619908 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 605/1206] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:17 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:18.627095 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8e84d5e0-9bbf-475f-9029-80fd48b8fff7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:18.627741 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8e84d5e0-9bbf-475f-9029-80fd48b8fff7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:18.633934 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8e84d5e0-9bbf-475f-9029-80fd48b8fff7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:18.634382 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8e84d5e0-9bbf-475f-9029-80fd48b8fff7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:18.635774 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8e84d5e0-9bbf-475f-9029-80fd48b8fff7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:18.636216 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8e84d5e0-9bbf-475f-9029-80fd48b8fff7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:18.777367 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8e84d5e0-9bbf-475f-9029-80fd48b8fff7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:18.784808 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8e84d5e0-9bbf-475f-9029-80fd48b8fff7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1260 microversion: 2.1 time: 0.162272 Feb 21 04:32:18.785370 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 602/1207] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:18 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:19.801356 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1cc779cd-78eb-4a18-9fa1-e7722e7f9240 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:19.801969 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1cc779cd-78eb-4a18-9fa1-e7722e7f9240 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:19.808493 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1cc779cd-78eb-4a18-9fa1-e7722e7f9240 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:19.808983 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1cc779cd-78eb-4a18-9fa1-e7722e7f9240 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:19.809758 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1cc779cd-78eb-4a18-9fa1-e7722e7f9240 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:19.810227 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1cc779cd-78eb-4a18-9fa1-e7722e7f9240 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:19.942581 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1cc779cd-78eb-4a18-9fa1-e7722e7f9240 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:19.950256 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1cc779cd-78eb-4a18-9fa1-e7722e7f9240 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1260 microversion: 2.1 time: 0.152549 Feb 21 04:32:19.950831 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 606/1208] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:19 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:20.967452 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-bf3f77c6-40d0-4b29-99c3-df2d0f3db5a5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:20.968057 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-bf3f77c6-40d0-4b29-99c3-df2d0f3db5a5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:20.974236 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bf3f77c6-40d0-4b29-99c3-df2d0f3db5a5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:20.974675 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bf3f77c6-40d0-4b29-99c3-df2d0f3db5a5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:20.975438 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bf3f77c6-40d0-4b29-99c3-df2d0f3db5a5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:20.975864 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-bf3f77c6-40d0-4b29-99c3-df2d0f3db5a5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:21.110014 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-bf3f77c6-40d0-4b29-99c3-df2d0f3db5a5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:21.117068 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-bf3f77c6-40d0-4b29-99c3-df2d0f3db5a5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1260 microversion: 2.1 time: 0.153177 Feb 21 04:32:21.117613 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 603/1209] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:20 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:22.133500 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-78caa71f-272d-427a-b7e5-3d839a6d0e1e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:22.134114 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-78caa71f-272d-427a-b7e5-3d839a6d0e1e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:22.140490 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78caa71f-272d-427a-b7e5-3d839a6d0e1e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:22.140967 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78caa71f-272d-427a-b7e5-3d839a6d0e1e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:22.141738 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78caa71f-272d-427a-b7e5-3d839a6d0e1e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:22.142175 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-78caa71f-272d-427a-b7e5-3d839a6d0e1e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:22.296522 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-78caa71f-272d-427a-b7e5-3d839a6d0e1e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:22.304413 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-78caa71f-272d-427a-b7e5-3d839a6d0e1e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1260 microversion: 2.1 time: 0.174573 Feb 21 04:32:22.305016 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 607/1210] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:22 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:23.320744 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-c1d9ceb0-3983-4487-83de-7494e5fd3cad tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:23.321350 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-c1d9ceb0-3983-4487-83de-7494e5fd3cad tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:23.327818 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c1d9ceb0-3983-4487-83de-7494e5fd3cad tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:23.328259 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c1d9ceb0-3983-4487-83de-7494e5fd3cad tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:23.329049 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c1d9ceb0-3983-4487-83de-7494e5fd3cad tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:23.329477 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-c1d9ceb0-3983-4487-83de-7494e5fd3cad tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:23.461806 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-c1d9ceb0-3983-4487-83de-7494e5fd3cad tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:23.469058 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-c1d9ceb0-3983-4487-83de-7494e5fd3cad tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1260 microversion: 2.1 time: 0.151870 Feb 21 04:32:23.469632 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 604/1211] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:23 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:24.000732 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:32:24.001306 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: Mon Feb 21 04:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:32:24.485443 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-bd8c0d38-8549-49bb-b4a9-ade4b896647d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:24.486044 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-bd8c0d38-8549-49bb-b4a9-ade4b896647d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:24.492300 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bd8c0d38-8549-49bb-b4a9-ade4b896647d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:24.492796 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bd8c0d38-8549-49bb-b4a9-ade4b896647d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:24.493569 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bd8c0d38-8549-49bb-b4a9-ade4b896647d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:24.494696 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-bd8c0d38-8549-49bb-b4a9-ade4b896647d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:24.646381 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-bd8c0d38-8549-49bb-b4a9-ade4b896647d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:24.654355 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-bd8c0d38-8549-49bb-b4a9-ade4b896647d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1260 microversion: 2.1 time: 0.172652 Feb 21 04:32:24.654920 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 608/1212] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:24 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:25.670960 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d908ca1b-2aab-4884-bf5a-e9ee66c86a2f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:25.671579 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d908ca1b-2aab-4884-bf5a-e9ee66c86a2f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:25.677881 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d908ca1b-2aab-4884-bf5a-e9ee66c86a2f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:25.678360 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d908ca1b-2aab-4884-bf5a-e9ee66c86a2f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:25.679140 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d908ca1b-2aab-4884-bf5a-e9ee66c86a2f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:25.679577 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d908ca1b-2aab-4884-bf5a-e9ee66c86a2f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:25.816612 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d908ca1b-2aab-4884-bf5a-e9ee66c86a2f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:25.824093 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d908ca1b-2aab-4884-bf5a-e9ee66c86a2f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1260 microversion: 2.1 time: 0.156795 Feb 21 04:32:25.824684 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 605/1213] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:25 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:26.840813 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-33f4f9fa-02ae-443e-9f8e-3e2ee14a18bb tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:26.841428 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-33f4f9fa-02ae-443e-9f8e-3e2ee14a18bb tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:26.847650 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-33f4f9fa-02ae-443e-9f8e-3e2ee14a18bb tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:26.848097 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-33f4f9fa-02ae-443e-9f8e-3e2ee14a18bb tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:26.848898 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-33f4f9fa-02ae-443e-9f8e-3e2ee14a18bb tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:26.849335 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-33f4f9fa-02ae-443e-9f8e-3e2ee14a18bb tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:26.982196 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-33f4f9fa-02ae-443e-9f8e-3e2ee14a18bb tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:26.989309 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-33f4f9fa-02ae-443e-9f8e-3e2ee14a18bb tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1260 microversion: 2.1 time: 0.152184 Feb 21 04:32:26.989860 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 609/1214] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:26 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:28.006186 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-8a2fb9d3-6d00-4fc0-a7c1-c9193f957fe7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:28.006793 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-8a2fb9d3-6d00-4fc0-a7c1-c9193f957fe7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:28.013568 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8a2fb9d3-6d00-4fc0-a7c1-c9193f957fe7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:28.014010 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8a2fb9d3-6d00-4fc0-a7c1-c9193f957fe7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:28.014808 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8a2fb9d3-6d00-4fc0-a7c1-c9193f957fe7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:28.015237 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-8a2fb9d3-6d00-4fc0-a7c1-c9193f957fe7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:28.144748 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-8a2fb9d3-6d00-4fc0-a7c1-c9193f957fe7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:28.152832 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-8a2fb9d3-6d00-4fc0-a7c1-c9193f957fe7 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1260 microversion: 2.1 time: 0.150090 Feb 21 04:32:28.153393 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 606/1215] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:28 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:29.169759 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e13930b7-1f3a-461c-ab56-405e6cab225b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:29.170383 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e13930b7-1f3a-461c-ab56-405e6cab225b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:29.176538 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e13930b7-1f3a-461c-ab56-405e6cab225b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:29.177023 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e13930b7-1f3a-461c-ab56-405e6cab225b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:29.177803 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e13930b7-1f3a-461c-ab56-405e6cab225b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:29.178236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e13930b7-1f3a-461c-ab56-405e6cab225b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:29.257185 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [req-48d4891b-8f5a-49a8-aff9-0d70b7d9c88c req-b8ac5417-b80a-4803-9880-72375de7a3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46cff89b-5103-458a-ad33-c4ecd25951ed", "name": "network-vif-plugged", "status": "completed", "tag": "6da3c99a-b3e2-431b-a334-fcde298d398a"}]} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:32:29.260287 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:32:29.260287 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: warnings.warn(msg) Feb 21 04:32:29.267195 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-48d4891b-8f5a-49a8-aff9-0d70b7d9c88c req-b8ac5417-b80a-4803-9880-72375de7a3e1 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:29.267635 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [req-48d4891b-8f5a-49a8-aff9-0d70b7d9c88c req-b8ac5417-b80a-4803-9880-72375de7a3e1 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:29.279012 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.compute.server_external_events [req-48d4891b-8f5a-49a8-aff9-0d70b7d9c88c req-b8ac5417-b80a-4803-9880-72375de7a3e1 service nova] Creating event network-vif-plugged:6da3c99a-b3e2-431b-a334-fcde298d398a for instance 46cff89b-5103-458a-ad33-c4ecd25951ed on hv-cinder-77398 Feb 21 04:32:29.284123 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [req-48d4891b-8f5a-49a8-aff9-0d70b7d9c88c req-b8ac5417-b80a-4803-9880-72375de7a3e1 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096860 Feb 21 04:32:29.284669 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 607/1216] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:32:29.320290 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e13930b7-1f3a-461c-ab56-405e6cab225b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:29.327722 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e13930b7-1f3a-461c-ab56-405e6cab225b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1260 microversion: 2.1 time: 0.162220 Feb 21 04:32:29.328290 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 610/1217] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:29 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:30.345316 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-0bcae63f-588c-410a-9d1e-2d82d7d757c5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:30.345929 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-0bcae63f-588c-410a-9d1e-2d82d7d757c5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:30.352347 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0bcae63f-588c-410a-9d1e-2d82d7d757c5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:30.352834 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0bcae63f-588c-410a-9d1e-2d82d7d757c5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:30.354082 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0bcae63f-588c-410a-9d1e-2d82d7d757c5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:30.354515 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-0bcae63f-588c-410a-9d1e-2d82d7d757c5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:30.484672 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-0bcae63f-588c-410a-9d1e-2d82d7d757c5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:30.491795 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-0bcae63f-588c-410a-9d1e-2d82d7d757c5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1260 microversion: 2.1 time: 0.151092 Feb 21 04:32:30.492376 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 608/1218] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:30 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:31.508747 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e0d3d573-5b6d-4e59-8ba0-377c54dfbe55 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:31.509363 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e0d3d573-5b6d-4e59-8ba0-377c54dfbe55 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:31.516192 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e0d3d573-5b6d-4e59-8ba0-377c54dfbe55 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:31.516657 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e0d3d573-5b6d-4e59-8ba0-377c54dfbe55 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:31.517447 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e0d3d573-5b6d-4e59-8ba0-377c54dfbe55 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:31.517887 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e0d3d573-5b6d-4e59-8ba0-377c54dfbe55 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:31.647676 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e0d3d573-5b6d-4e59-8ba0-377c54dfbe55 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:31.655164 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e0d3d573-5b6d-4e59-8ba0-377c54dfbe55 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1445 microversion: 2.1 time: 0.150109 Feb 21 04:32:31.655729 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 611/1219] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:31 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:31.671502 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-14646598-8255-4b73-8762-cd67f1e757a9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:32:31.672109 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-14646598-8255-4b73-8762-cd67f1e757a9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:32:31.678328 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-14646598-8255-4b73-8762-cd67f1e757a9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:31.678764 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-14646598-8255-4b73-8762-cd67f1e757a9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:31.679526 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-14646598-8255-4b73-8762-cd67f1e757a9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:31.679950 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-14646598-8255-4b73-8762-cd67f1e757a9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:31.814996 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-14646598-8255-4b73-8762-cd67f1e757a9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:32:31.822151 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-14646598-8255-4b73-8762-cd67f1e757a9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1445 microversion: 2.1 time: 0.154355 Feb 21 04:32:31.822706 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 609/1220] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:32:31 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:32:33.455604 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-4c4173dc-fa94-4434-88fe-75999d970812 req-2f281da0-d786-4a20-be5a-14e623e5e658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46cff89b-5103-458a-ad33-c4ecd25951ed", "tag": "6da3c99a-b3e2-431b-a334-fcde298d398a"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:32:33.457115 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:32:33.457115 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:32:33.463951 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-4c4173dc-fa94-4434-88fe-75999d970812 req-2f281da0-d786-4a20-be5a-14e623e5e658 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:32:33.464391 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-4c4173dc-fa94-4434-88fe-75999d970812 req-2f281da0-d786-4a20-be5a-14e623e5e658 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:32:33.474775 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-4c4173dc-fa94-4434-88fe-75999d970812 req-2f281da0-d786-4a20-be5a-14e623e5e658 service nova] Creating event network-changed:6da3c99a-b3e2-431b-a334-fcde298d398a for instance 46cff89b-5103-458a-ad33-c4ecd25951ed on hv-cinder-77398 Feb 21 04:32:33.480524 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-4c4173dc-fa94-4434-88fe-75999d970812 req-2f281da0-d786-4a20-be5a-14e623e5e658 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028551 Feb 21 04:32:33.481700 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 612/1221] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:33:21.395316 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:33:21.395829 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: Mon Feb 21 04:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:34:18.780920 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:34:18.781405 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: Mon Feb 21 04:34:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:34:47.382930 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-25e0380c-ee7b-4614-a3f1-eb04dc99d1ed tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:34:47.383570 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-25e0380c-ee7b-4614-a3f1-eb04dc99d1ed tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:34:47.389867 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-25e0380c-ee7b-4614-a3f1-eb04dc99d1ed tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:47.390307 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-25e0380c-ee7b-4614-a3f1-eb04dc99d1ed tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:47.391072 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-25e0380c-ee7b-4614-a3f1-eb04dc99d1ed tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:47.391497 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-25e0380c-ee7b-4614-a3f1-eb04dc99d1ed tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:47.413842 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.objects.instance [None req-25e0380c-ee7b-4614-a3f1-eb04dc99d1ed tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lazy-loading 'flavor' on Instance uuid 46cff89b-5103-458a-ad33-c4ecd25951ed {{(pid=116570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 04:34:47.482707 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-25e0380c-ee7b-4614-a3f1-eb04dc99d1ed tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "POST /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed/action" status: 202 len: 0 microversion: 2.1 time: 0.104191 Feb 21 04:34:47.483279 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 610/1222] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:34:47 2022] POST /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:34:47.492573 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-f51f5d2c-b980-43c1-84ed-0a52ecec327c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:34:47.493304 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-f51f5d2c-b980-43c1-84ed-0a52ecec327c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:34:47.499778 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f51f5d2c-b980-43c1-84ed-0a52ecec327c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:47.500255 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f51f5d2c-b980-43c1-84ed-0a52ecec327c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:47.501784 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f51f5d2c-b980-43c1-84ed-0a52ecec327c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:47.501784 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-f51f5d2c-b980-43c1-84ed-0a52ecec327c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:47.684991 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-f51f5d2c-b980-43c1-84ed-0a52ecec327c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:34:47.692154 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-f51f5d2c-b980-43c1-84ed-0a52ecec327c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1569 microversion: 2.1 time: 0.204428 Feb 21 04:34:47.692722 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 613/1223] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:34:47 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:34:48.710936 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5fa111b1-d365-4942-a599-5d3f74eb2041 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:34:48.711666 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5fa111b1-d365-4942-a599-5d3f74eb2041 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:34:48.718249 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5fa111b1-d365-4942-a599-5d3f74eb2041 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:48.718698 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5fa111b1-d365-4942-a599-5d3f74eb2041 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:48.719502 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5fa111b1-d365-4942-a599-5d3f74eb2041 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:48.719933 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5fa111b1-d365-4942-a599-5d3f74eb2041 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:49.143327 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5fa111b1-d365-4942-a599-5d3f74eb2041 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:34:49.151255 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5fa111b1-d365-4942-a599-5d3f74eb2041 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1569 microversion: 2.1 time: 0.444922 Feb 21 04:34:49.151812 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 611/1224] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:34:48 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1569 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:34:50.168854 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-e233f1ef-16fb-41d9-aa85-a79b962cc5f2 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:34:50.169464 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-e233f1ef-16fb-41d9-aa85-a79b962cc5f2 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:34:50.175950 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e233f1ef-16fb-41d9-aa85-a79b962cc5f2 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:50.176393 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e233f1ef-16fb-41d9-aa85-a79b962cc5f2 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:50.177198 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e233f1ef-16fb-41d9-aa85-a79b962cc5f2 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:50.177627 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-e233f1ef-16fb-41d9-aa85-a79b962cc5f2 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:50.308046 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-e233f1ef-16fb-41d9-aa85-a79b962cc5f2 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:34:50.315314 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-e233f1ef-16fb-41d9-aa85-a79b962cc5f2 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1569 microversion: 2.1 time: 0.150681 Feb 21 04:34:50.315869 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 614/1225] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:34:50 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:34:51.332848 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-163487bf-d612-41f7-bd29-a624d7697385 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:34:51.333462 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-163487bf-d612-41f7-bd29-a624d7697385 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:34:51.339717 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-163487bf-d612-41f7-bd29-a624d7697385 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:51.340159 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-163487bf-d612-41f7-bd29-a624d7697385 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:51.340955 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-163487bf-d612-41f7-bd29-a624d7697385 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:51.341387 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-163487bf-d612-41f7-bd29-a624d7697385 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:51.473835 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-163487bf-d612-41f7-bd29-a624d7697385 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:34:51.481600 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-163487bf-d612-41f7-bd29-a624d7697385 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1569 microversion: 2.1 time: 0.152456 Feb 21 04:34:51.482160 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 612/1226] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:34:51 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:34:52.499022 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-8bf25411-5eca-4761-8e27-c9897047ec59 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:34:52.499578 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-8bf25411-5eca-4761-8e27-c9897047ec59 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:34:52.505745 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8bf25411-5eca-4761-8e27-c9897047ec59 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:52.506185 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8bf25411-5eca-4761-8e27-c9897047ec59 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:52.506948 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8bf25411-5eca-4761-8e27-c9897047ec59 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:52.507372 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-8bf25411-5eca-4761-8e27-c9897047ec59 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:52.637941 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-8bf25411-5eca-4761-8e27-c9897047ec59 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:34:52.645899 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-8bf25411-5eca-4761-8e27-c9897047ec59 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1569 microversion: 2.1 time: 0.150597 Feb 21 04:34:52.646472 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 615/1227] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:34:52 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:34:53.663721 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-f889f4ad-7621-4076-b5af-2f60afc1cada tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:34:53.664365 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-f889f4ad-7621-4076-b5af-2f60afc1cada tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:34:53.670753 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f889f4ad-7621-4076-b5af-2f60afc1cada tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:53.671200 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f889f4ad-7621-4076-b5af-2f60afc1cada tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:53.671964 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f889f4ad-7621-4076-b5af-2f60afc1cada tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:53.672396 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-f889f4ad-7621-4076-b5af-2f60afc1cada tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:53.803167 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-f889f4ad-7621-4076-b5af-2f60afc1cada tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:34:53.810342 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-f889f4ad-7621-4076-b5af-2f60afc1cada tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1569 microversion: 2.1 time: 0.150435 Feb 21 04:34:53.810890 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 613/1228] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:34:53 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:34:54.827025 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-26a6d9b6-3e03-4b1f-823f-7ba0f6bb873c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:34:54.827659 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-26a6d9b6-3e03-4b1f-823f-7ba0f6bb873c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:34:54.833890 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26a6d9b6-3e03-4b1f-823f-7ba0f6bb873c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:54.834331 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26a6d9b6-3e03-4b1f-823f-7ba0f6bb873c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:54.835095 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26a6d9b6-3e03-4b1f-823f-7ba0f6bb873c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:54.835524 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-26a6d9b6-3e03-4b1f-823f-7ba0f6bb873c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:54.969162 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-26a6d9b6-3e03-4b1f-823f-7ba0f6bb873c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:34:54.976352 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-26a6d9b6-3e03-4b1f-823f-7ba0f6bb873c tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1569 microversion: 2.1 time: 0.152978 Feb 21 04:34:54.976950 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 616/1229] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:34:54 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:34:55.994234 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e9b8cf45-5104-435b-a81c-c66d9b534256 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:34:55.994855 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e9b8cf45-5104-435b-a81c-c66d9b534256 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:34:56.001048 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e9b8cf45-5104-435b-a81c-c66d9b534256 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:56.001523 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e9b8cf45-5104-435b-a81c-c66d9b534256 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:56.002292 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e9b8cf45-5104-435b-a81c-c66d9b534256 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:56.002722 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e9b8cf45-5104-435b-a81c-c66d9b534256 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:56.132872 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e9b8cf45-5104-435b-a81c-c66d9b534256 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:34:56.141804 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e9b8cf45-5104-435b-a81c-c66d9b534256 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1569 microversion: 2.1 time: 0.151824 Feb 21 04:34:56.142364 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 614/1230] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:34:55 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:34:57.158824 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-6bb059d7-34f0-44c1-a3fc-b685e68e4bf9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:34:57.159430 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-6bb059d7-34f0-44c1-a3fc-b685e68e4bf9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:34:57.166198 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6bb059d7-34f0-44c1-a3fc-b685e68e4bf9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:57.166643 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6bb059d7-34f0-44c1-a3fc-b685e68e4bf9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:57.167404 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6bb059d7-34f0-44c1-a3fc-b685e68e4bf9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:57.167834 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-6bb059d7-34f0-44c1-a3fc-b685e68e4bf9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:57.301615 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-6bb059d7-34f0-44c1-a3fc-b685e68e4bf9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:34:57.309529 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-6bb059d7-34f0-44c1-a3fc-b685e68e4bf9 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1569 microversion: 2.1 time: 0.154320 Feb 21 04:34:57.310092 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 617/1231] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:34:57 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:34:58.327434 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-e75abbac-2ecc-4e04-b8f0-0853bc6951c3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:34:58.328005 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-e75abbac-2ecc-4e04-b8f0-0853bc6951c3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:34:58.334209 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e75abbac-2ecc-4e04-b8f0-0853bc6951c3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:58.334656 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e75abbac-2ecc-4e04-b8f0-0853bc6951c3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:58.335432 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e75abbac-2ecc-4e04-b8f0-0853bc6951c3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:58.335864 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-e75abbac-2ecc-4e04-b8f0-0853bc6951c3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:58.472074 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-e75abbac-2ecc-4e04-b8f0-0853bc6951c3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:34:58.479363 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-e75abbac-2ecc-4e04-b8f0-0853bc6951c3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1569 microversion: 2.1 time: 0.155740 Feb 21 04:34:58.479922 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 615/1232] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:34:58 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 04:34:59.496346 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-71ef7f57-dc1c-4035-a122-1ea2967d9764 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:34:59.496979 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-71ef7f57-dc1c-4035-a122-1ea2967d9764 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:34:59.503190 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-71ef7f57-dc1c-4035-a122-1ea2967d9764 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:59.503635 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-71ef7f57-dc1c-4035-a122-1ea2967d9764 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:59.504406 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-71ef7f57-dc1c-4035-a122-1ea2967d9764 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:34:59.504879 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-71ef7f57-dc1c-4035-a122-1ea2967d9764 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:34:59.639748 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-71ef7f57-dc1c-4035-a122-1ea2967d9764 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:34:59.647796 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-71ef7f57-dc1c-4035-a122-1ea2967d9764 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1569 microversion: 2.1 time: 0.155093 Feb 21 04:34:59.648359 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 618/1233] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:34:59 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:00.666226 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-300e86cb-7dc3-43dc-9e24-70c7422d259e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:00.666825 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-300e86cb-7dc3-43dc-9e24-70c7422d259e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:00.673024 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-300e86cb-7dc3-43dc-9e24-70c7422d259e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:00.673464 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-300e86cb-7dc3-43dc-9e24-70c7422d259e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:00.674253 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-300e86cb-7dc3-43dc-9e24-70c7422d259e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:00.674678 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-300e86cb-7dc3-43dc-9e24-70c7422d259e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:00.809637 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-300e86cb-7dc3-43dc-9e24-70c7422d259e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:00.816835 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-300e86cb-7dc3-43dc-9e24-70c7422d259e tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1510 microversion: 2.1 time: 0.154834 Feb 21 04:35:00.817398 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 616/1234] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:00 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:00.833050 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-61ee5ded-c4a1-4f5a-94e5-b15799ecaccc tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:35:00.833613 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-61ee5ded-c4a1-4f5a-94e5-b15799ecaccc tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:00.840580 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-61ee5ded-c4a1-4f5a-94e5-b15799ecaccc tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:00.841052 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-61ee5ded-c4a1-4f5a-94e5-b15799ecaccc tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:00.841815 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-61ee5ded-c4a1-4f5a-94e5-b15799ecaccc tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:00.842242 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-61ee5ded-c4a1-4f5a-94e5-b15799ecaccc tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:00.975734 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-61ee5ded-c4a1-4f5a-94e5-b15799ecaccc tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "POST /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed/action" status: 202 len: 0 microversion: 2.1 time: 0.145900 Feb 21 04:35:00.976669 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 619/1235] 10.222.0.10 () {60 vars in 1277 bytes} [Mon Feb 21 04:35:00 2022] POST /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:35:00.984463 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5e338c61-becf-47d1-b1da-07185699f322 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:00.985183 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5e338c61-becf-47d1-b1da-07185699f322 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:00.991008 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5e338c61-becf-47d1-b1da-07185699f322 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:00.991455 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5e338c61-becf-47d1-b1da-07185699f322 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:00.992260 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5e338c61-becf-47d1-b1da-07185699f322 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:00.992712 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5e338c61-becf-47d1-b1da-07185699f322 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:01.173196 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5e338c61-becf-47d1-b1da-07185699f322 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:01.180350 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5e338c61-becf-47d1-b1da-07185699f322 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1518 microversion: 2.1 time: 0.199490 Feb 21 04:35:01.181652 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 617/1236] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:00 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1518 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:01.856797 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-d0b0ce0d-f20c-4b8f-92e9-d77bdc1f9191 req-28bbed21-fbd2-4196-8f5f-e3dfb300f49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46cff89b-5103-458a-ad33-c4ecd25951ed", "name": "network-vif-unplugged", "status": "completed", "tag": "6da3c99a-b3e2-431b-a334-fcde298d398a"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:35:01.858596 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:35:01.858596 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:35:01.866938 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-d0b0ce0d-f20c-4b8f-92e9-d77bdc1f9191 req-28bbed21-fbd2-4196-8f5f-e3dfb300f49b service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:01.867490 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-d0b0ce0d-f20c-4b8f-92e9-d77bdc1f9191 req-28bbed21-fbd2-4196-8f5f-e3dfb300f49b service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:01.879592 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.compute.server_external_events [req-d0b0ce0d-f20c-4b8f-92e9-d77bdc1f9191 req-28bbed21-fbd2-4196-8f5f-e3dfb300f49b service nova] Unable to find a host for instance 46cff89b-5103-458a-ad33-c4ecd25951ed. Dropping event network-vif-unplugged {{(pid=116571) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 21 04:35:01.880224 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-d0b0ce0d-f20c-4b8f-92e9-d77bdc1f9191 req-28bbed21-fbd2-4196-8f5f-e3dfb300f49b service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027687 Feb 21 04:35:01.881054 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 620/1237] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 21 04:35:02.198082 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-16adf81e-c325-4acf-9f9d-cadb33340aa1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:02.198731 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-16adf81e-c325-4acf-9f9d-cadb33340aa1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:02.204965 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16adf81e-c325-4acf-9f9d-cadb33340aa1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:02.205415 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16adf81e-c325-4acf-9f9d-cadb33340aa1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:02.206193 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16adf81e-c325-4acf-9f9d-cadb33340aa1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:02.206633 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-16adf81e-c325-4acf-9f9d-cadb33340aa1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:02.340764 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-16adf81e-c325-4acf-9f9d-cadb33340aa1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:02.348142 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-16adf81e-c325-4acf-9f9d-cadb33340aa1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1576 microversion: 2.1 time: 0.153704 Feb 21 04:35:02.348735 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 618/1238] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:02 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:03.365409 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-79bf6c8a-33a3-419b-9ab2-db982c9191e5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:03.365998 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-79bf6c8a-33a3-419b-9ab2-db982c9191e5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:03.372903 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79bf6c8a-33a3-419b-9ab2-db982c9191e5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:03.373350 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79bf6c8a-33a3-419b-9ab2-db982c9191e5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:03.374120 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79bf6c8a-33a3-419b-9ab2-db982c9191e5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:03.374553 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-79bf6c8a-33a3-419b-9ab2-db982c9191e5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:03.508527 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-79bf6c8a-33a3-419b-9ab2-db982c9191e5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:03.515739 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-79bf6c8a-33a3-419b-9ab2-db982c9191e5 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1576 microversion: 2.1 time: 0.153982 Feb 21 04:35:03.516304 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 621/1239] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:03 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:04.532823 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d4bf630a-c163-4dc2-a7fd-11fd1b930311 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:04.533370 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d4bf630a-c163-4dc2-a7fd-11fd1b930311 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:04.539572 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d4bf630a-c163-4dc2-a7fd-11fd1b930311 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:04.540017 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d4bf630a-c163-4dc2-a7fd-11fd1b930311 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:04.540819 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d4bf630a-c163-4dc2-a7fd-11fd1b930311 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:04.541255 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d4bf630a-c163-4dc2-a7fd-11fd1b930311 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:04.672828 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d4bf630a-c163-4dc2-a7fd-11fd1b930311 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:04.680012 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d4bf630a-c163-4dc2-a7fd-11fd1b930311 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1576 microversion: 2.1 time: 0.150975 Feb 21 04:35:04.680570 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 619/1240] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:04 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:05.697261 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-4e531d71-2bd2-414a-8969-9894e9d31c09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:05.697859 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-4e531d71-2bd2-414a-8969-9894e9d31c09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:05.704157 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4e531d71-2bd2-414a-8969-9894e9d31c09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:05.704603 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4e531d71-2bd2-414a-8969-9894e9d31c09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:05.705402 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4e531d71-2bd2-414a-8969-9894e9d31c09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:05.705840 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-4e531d71-2bd2-414a-8969-9894e9d31c09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:05.837758 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-4e531d71-2bd2-414a-8969-9894e9d31c09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:05.845564 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-4e531d71-2bd2-414a-8969-9894e9d31c09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1576 microversion: 2.1 time: 0.151947 Feb 21 04:35:05.846125 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 622/1241] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:05 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:06.862598 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5eed7f18-a925-4c3f-a4cb-2234d9fd0d4f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:06.863239 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5eed7f18-a925-4c3f-a4cb-2234d9fd0d4f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:06.869553 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5eed7f18-a925-4c3f-a4cb-2234d9fd0d4f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:06.869998 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5eed7f18-a925-4c3f-a4cb-2234d9fd0d4f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:06.870766 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5eed7f18-a925-4c3f-a4cb-2234d9fd0d4f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:06.871199 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5eed7f18-a925-4c3f-a4cb-2234d9fd0d4f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:07.000011 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5eed7f18-a925-4c3f-a4cb-2234d9fd0d4f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:07.007177 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5eed7f18-a925-4c3f-a4cb-2234d9fd0d4f tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1576 microversion: 2.1 time: 0.148223 Feb 21 04:35:07.007739 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 620/1242] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:06 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:08.025358 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-1d0ea41b-f939-43aa-adec-456db5e88e09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:08.026402 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-1d0ea41b-f939-43aa-adec-456db5e88e09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:08.032861 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1d0ea41b-f939-43aa-adec-456db5e88e09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:08.033311 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1d0ea41b-f939-43aa-adec-456db5e88e09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:08.034082 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1d0ea41b-f939-43aa-adec-456db5e88e09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:08.034536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-1d0ea41b-f939-43aa-adec-456db5e88e09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:08.165493 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-1d0ea41b-f939-43aa-adec-456db5e88e09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:08.173332 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-1d0ea41b-f939-43aa-adec-456db5e88e09 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1576 microversion: 2.1 time: 0.152005 Feb 21 04:35:08.173888 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 623/1243] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:08 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:09.189344 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-6621ff23-0602-4dcb-a049-981c1363dcb3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:09.189988 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-6621ff23-0602-4dcb-a049-981c1363dcb3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:09.196317 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6621ff23-0602-4dcb-a049-981c1363dcb3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:09.196801 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6621ff23-0602-4dcb-a049-981c1363dcb3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:09.197577 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6621ff23-0602-4dcb-a049-981c1363dcb3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:09.198557 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-6621ff23-0602-4dcb-a049-981c1363dcb3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:09.336555 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-6621ff23-0602-4dcb-a049-981c1363dcb3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:09.344403 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-6621ff23-0602-4dcb-a049-981c1363dcb3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1576 microversion: 2.1 time: 0.158705 Feb 21 04:35:09.344998 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 621/1244] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:09 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:10.361297 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-36f05fb6-c8ff-4356-b5e3-887b6bee1fff tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:10.361922 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-36f05fb6-c8ff-4356-b5e3-887b6bee1fff tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:10.368081 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-36f05fb6-c8ff-4356-b5e3-887b6bee1fff tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:10.368536 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-36f05fb6-c8ff-4356-b5e3-887b6bee1fff tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:10.369359 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-36f05fb6-c8ff-4356-b5e3-887b6bee1fff tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:10.370327 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-36f05fb6-c8ff-4356-b5e3-887b6bee1fff tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:10.506285 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-36f05fb6-c8ff-4356-b5e3-887b6bee1fff tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:10.514113 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-36f05fb6-c8ff-4356-b5e3-887b6bee1fff tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1576 microversion: 2.1 time: 0.156497 Feb 21 04:35:10.514672 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 624/1245] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:10 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:11.531295 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-fcba86a2-0a8d-4e48-a775-435aab02f141 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:11.531973 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-fcba86a2-0a8d-4e48-a775-435aab02f141 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:11.538150 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fcba86a2-0a8d-4e48-a775-435aab02f141 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:11.538599 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fcba86a2-0a8d-4e48-a775-435aab02f141 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:11.539374 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fcba86a2-0a8d-4e48-a775-435aab02f141 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:11.539807 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-fcba86a2-0a8d-4e48-a775-435aab02f141 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:11.673577 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-fcba86a2-0a8d-4e48-a775-435aab02f141 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:11.680911 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-fcba86a2-0a8d-4e48-a775-435aab02f141 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1576 microversion: 2.1 time: 0.153520 Feb 21 04:35:11.681476 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 622/1246] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:11 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:11.931149 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-e8d4c5bf-1b73-4bc8-b2b9-c802b6a5eaa0 req-edb4cb15-0af7-43a8-9ad5-411119845cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46cff89b-5103-458a-ad33-c4ecd25951ed", "name": "network-vif-plugged", "status": "completed", "tag": "6da3c99a-b3e2-431b-a334-fcde298d398a"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:35:11.933134 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:35:11.933134 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:35:11.940304 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-e8d4c5bf-1b73-4bc8-b2b9-c802b6a5eaa0 req-edb4cb15-0af7-43a8-9ad5-411119845cbc service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:11.940768 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-e8d4c5bf-1b73-4bc8-b2b9-c802b6a5eaa0 req-edb4cb15-0af7-43a8-9ad5-411119845cbc service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:11.952249 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-e8d4c5bf-1b73-4bc8-b2b9-c802b6a5eaa0 req-edb4cb15-0af7-43a8-9ad5-411119845cbc service nova] Creating event network-vif-plugged:6da3c99a-b3e2-431b-a334-fcde298d398a for instance 46cff89b-5103-458a-ad33-c4ecd25951ed on hv-cinder-77398 Feb 21 04:35:11.957301 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-e8d4c5bf-1b73-4bc8-b2b9-c802b6a5eaa0 req-edb4cb15-0af7-43a8-9ad5-411119845cbc service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029689 Feb 21 04:35:11.957897 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 625/1247] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:35:12.697348 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-867b1862-485c-4067-858b-91915c9301f3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:12.697955 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-867b1862-485c-4067-858b-91915c9301f3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:12.704169 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-867b1862-485c-4067-858b-91915c9301f3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:12.704613 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-867b1862-485c-4067-858b-91915c9301f3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:12.706570 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-867b1862-485c-4067-858b-91915c9301f3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:12.707051 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-867b1862-485c-4067-858b-91915c9301f3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:12.843273 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-867b1862-485c-4067-858b-91915c9301f3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:12.850458 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-867b1862-485c-4067-858b-91915c9301f3 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1576 microversion: 2.1 time: 0.156740 Feb 21 04:35:12.851021 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 623/1248] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:12 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:35:13.868037 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-61bc8a2f-9dcf-49d9-8ec9-5d895ac8f1c1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:35:13.868763 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-61bc8a2f-9dcf-49d9-8ec9-5d895ac8f1c1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:35:13.875403 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-61bc8a2f-9dcf-49d9-8ec9-5d895ac8f1c1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:13.875851 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-61bc8a2f-9dcf-49d9-8ec9-5d895ac8f1c1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:13.876623 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-61bc8a2f-9dcf-49d9-8ec9-5d895ac8f1c1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:35:13.877079 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-61bc8a2f-9dcf-49d9-8ec9-5d895ac8f1c1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:35:14.013589 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-61bc8a2f-9dcf-49d9-8ec9-5d895ac8f1c1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:35:14.020958 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-61bc8a2f-9dcf-49d9-8ec9-5d895ac8f1c1 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1563 microversion: 2.1 time: 0.157309 Feb 21 04:35:14.021478 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 626/1249] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:35:13 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:36:41.403432 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:36:41.403997 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: Mon Feb 21 04:36:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:36:41.861651 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-b16f7a33-71eb-48d6-b415-44938638de91 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:36:41.862215 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b16f7a33-71eb-48d6-b415-44938638de91 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:36:41.869038 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b16f7a33-71eb-48d6-b415-44938638de91 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:36:41.869611 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b16f7a33-71eb-48d6-b415-44938638de91 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:36:41.870494 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b16f7a33-71eb-48d6-b415-44938638de91 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:36:41.870990 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-b16f7a33-71eb-48d6-b415-44938638de91 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:36:41.896668 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-b16f7a33-71eb-48d6-b415-44938638de91 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Going to try to terminate instance {{(pid=116570) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 04:36:41.922038 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-bf023bed-3849-4a73-9eb2-2e64856f7924 req-344d73c8-7f0c-4063-b766-800b3c63cbdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46cff89b-5103-458a-ad33-c4ecd25951ed", "tag": "6da3c99a-b3e2-431b-a334-fcde298d398a"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:36:41.923590 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:36:41.923590 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:36:41.930517 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-bf023bed-3849-4a73-9eb2-2e64856f7924 req-344d73c8-7f0c-4063-b766-800b3c63cbdd service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:36:41.930985 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-bf023bed-3849-4a73-9eb2-2e64856f7924 req-344d73c8-7f0c-4063-b766-800b3c63cbdd service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:36:41.942098 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-bf023bed-3849-4a73-9eb2-2e64856f7924 req-344d73c8-7f0c-4063-b766-800b3c63cbdd service nova] Creating event network-changed:6da3c99a-b3e2-431b-a334-fcde298d398a for instance 46cff89b-5103-458a-ad33-c4ecd25951ed on hv-cinder-77398 Feb 21 04:36:41.947929 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-bf023bed-3849-4a73-9eb2-2e64856f7924 req-344d73c8-7f0c-4063-b766-800b3c63cbdd service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087835 Feb 21 04:36:41.948677 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 627/1250] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 04:36:41.987326 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-b16f7a33-71eb-48d6-b415-44938638de91 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "DELETE /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 204 len: 0 microversion: 2.1 time: 0.130201 Feb 21 04:36:41.987839 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 624/1251] 10.222.0.10 () {58 vars in 1238 bytes} [Mon Feb 21 04:36:41 2022] DELETE /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 04:36:41.997366 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-5da5dc01-4ea2-430a-8f90-1dc488fc797d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:36:41.998076 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-5da5dc01-4ea2-430a-8f90-1dc488fc797d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:36:42.004653 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5da5dc01-4ea2-430a-8f90-1dc488fc797d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:36:42.005120 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5da5dc01-4ea2-430a-8f90-1dc488fc797d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:36:42.005907 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5da5dc01-4ea2-430a-8f90-1dc488fc797d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:36:42.007053 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-5da5dc01-4ea2-430a-8f90-1dc488fc797d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:36:42.154755 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.policy [None req-5da5dc01-4ea2-430a-8f90-1dc488fc797d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116571) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:36:42.162346 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-5da5dc01-4ea2-430a-8f90-1dc488fc797d tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1569 microversion: 2.1 time: 0.170121 Feb 21 04:36:42.163236 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 628/1252] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:36:41 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:36:43.182158 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-5a3478b4-8fcc-4659-8f43-2fef0e963505 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:36:43.182917 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-5a3478b4-8fcc-4659-8f43-2fef0e963505 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:36:43.189221 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a3478b4-8fcc-4659-8f43-2fef0e963505 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:36:43.189666 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a3478b4-8fcc-4659-8f43-2fef0e963505 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:36:43.190439 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a3478b4-8fcc-4659-8f43-2fef0e963505 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:36:43.190872 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-5a3478b4-8fcc-4659-8f43-2fef0e963505 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:36:43.323301 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-5a3478b4-8fcc-4659-8f43-2fef0e963505 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:36:43.330547 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-5a3478b4-8fcc-4659-8f43-2fef0e963505 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1451 microversion: 2.1 time: 0.152976 Feb 21 04:36:43.331105 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 625/1253] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:36:43 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:36:44.189763 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [req-b59a4893-f409-43c1-a3cc-85517a40b1b4 req-4a4a0fa0-945f-455c-92d9-7f5a0a4ea0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46cff89b-5103-458a-ad33-c4ecd25951ed", "name": "network-vif-deleted", "tag": "6da3c99a-b3e2-431b-a334-fcde298d398a"}]} {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 04:36:44.191254 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 04:36:44.191254 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: warnings.warn(msg) Feb 21 04:36:44.198846 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-b59a4893-f409-43c1-a3cc-85517a40b1b4 req-4a4a0fa0-945f-455c-92d9-7f5a0a4ea0c4 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:36:44.199318 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [req-b59a4893-f409-43c1-a3cc-85517a40b1b4 req-4a4a0fa0-945f-455c-92d9-7f5a0a4ea0c4 service nova] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:36:44.210064 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.compute.server_external_events [req-b59a4893-f409-43c1-a3cc-85517a40b1b4 req-4a4a0fa0-945f-455c-92d9-7f5a0a4ea0c4 service nova] Creating event network-vif-deleted:6da3c99a-b3e2-431b-a334-fcde298d398a for instance 46cff89b-5103-458a-ad33-c4ecd25951ed on hv-cinder-77398 Feb 21 04:36:44.215472 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [req-b59a4893-f409-43c1-a3cc-85517a40b1b4 req-4a4a0fa0-945f-455c-92d9-7f5a0a4ea0c4 service nova] 10.222.0.10 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087125 Feb 21 04:36:44.216064 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 629/1254] 10.222.0.10 () {64 vars in 1317 bytes} [Mon Feb 21 04:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 04:36:44.347486 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-d0c784e6-8009-4d12-aeb2-42e3213ae02b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:36:44.348047 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.compute.api [None req-d0c784e6-8009-4d12-aeb2-42e3213ae02b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116570) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:36:44.354086 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d0c784e6-8009-4d12-aeb2-42e3213ae02b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:36:44.354530 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d0c784e6-8009-4d12-aeb2-42e3213ae02b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:36:44.355295 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d0c784e6-8009-4d12-aeb2-42e3213ae02b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:36:44.355723 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG oslo_concurrency.lockutils [None req-d0c784e6-8009-4d12-aeb2-42e3213ae02b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:36:44.421989 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.policy [None req-d0c784e6-8009-4d12-aeb2-42e3213ae02b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f24dfa9362e44c9cad1a8b20485b0a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00abea86acb349fab42fee7d8bdb778c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116570) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 04:36:44.430687 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-d0c784e6-8009-4d12-aeb2-42e3213ae02b tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 200 len: 1219 microversion: 2.1 time: 0.086823 Feb 21 04:36:44.440005 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 626/1255] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:36:44 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 04:36:45.448441 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-eafd9f98-ae92-45ad-a10e-b238c51586b4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '>' {{(pid=116571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:36:45.449169 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.compute.api [None req-eafd9f98-ae92-45ad-a10e-b238c51586b4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] [instance: 46cff89b-5103-458a-ad33-c4ecd25951ed] Fetching instance by UUID {{(pid=116571) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 04:36:45.455300 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eafd9f98-ae92-45ad-a10e-b238c51586b4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:36:45.455749 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eafd9f98-ae92-45ad-a10e-b238c51586b4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:36:45.456528 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eafd9f98-ae92-45ad-a10e-b238c51586b4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 04:36:45.456994 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG oslo_concurrency.lockutils [None req-eafd9f98-ae92-45ad-a10e-b238c51586b4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Lock "5698d2f8-fc88-4d55-adc3-7e1555697e28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 04:36:45.470505 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.wsgi [None req-eafd9f98-ae92-45ad-a10e-b238c51586b4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] HTTP exception thrown: Instance 46cff89b-5103-458a-ad33-c4ecd25951ed could not be found. Feb 21 04:36:45.471146 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: DEBUG nova.api.openstack.wsgi [None req-eafd9f98-ae92-45ad-a10e-b238c51586b4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Returning 404 to user: Instance 46cff89b-5103-458a-ad33-c4ecd25951ed could not be found. {{(pid=116571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 04:36:45.471957 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO nova.api.openstack.requestlog [None req-eafd9f98-ae92-45ad-a10e-b238c51586b4 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed" status: 404 len: 111 microversion: 2.1 time: 0.028047 Feb 21 04:36:45.472481 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: [pid: 116571|app: 0|req: 630/1256] 10.222.0.10 () {58 vars in 1235 bytes} [Mon Feb 21 04:36:45 2022] GET /compute/v2.1/servers/46cff89b-5103-458a-ad33-c4ecd25951ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 04:36:45.628990 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: DEBUG nova.api.openstack.wsgi [None req-98dee1d2-ac95-4fc9-ad49-b4a4281c8e38 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] Calling method '.version_select at 0x7feee145b550>' {{(pid=116570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 04:36:45.653606 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO nova.api.openstack.requestlog [None req-98dee1d2-ac95-4fc9-ad49-b4a4281c8e38 tempest-TestShelveInstance-209734327 tempest-TestShelveInstance-209734327-project] 10.222.0.10 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2144632072" status: 202 len: 0 microversion: 2.1 time: 0.028599 Feb 21 04:36:45.654186 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: [pid: 116570|app: 0|req: 627/1257] 10.222.0.10 () {58 vars in 1253 bytes} [Mon Feb 21 04:36:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2144632072 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 04:37:24.011497 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Feb 21 04:37:24.012144 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: Mon Feb 21 04:37:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:37:27.645247 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:37:27.645850 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: Mon Feb 21 04:37:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:37:38.788617 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:37:38.789101 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: Mon Feb 21 04:37:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:39:22.489718 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:39:22.490388 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: Mon Feb 21 04:39:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:39:49.978941 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:39:49.979579 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: Mon Feb 21 04:39:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:40:01.413019 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:40:01.413800 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: Mon Feb 21 04:40:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:40:44.019530 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:40:44.020043 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: Mon Feb 21 04:40:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:40:47.653892 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:40:47.654492 dv-cinder-773985-36-iscsi devstack@n-api.service[116570]: Mon Feb 21 04:40:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 04:40:58.797294 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 04:40:58.797766 dv-cinder-773985-36-iscsi devstack@n-api.service[116571]: Mon Feb 21 04:40:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!